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Abstract. For a system of ODEs defined on an open, convex domain U con- 
taining a positively invariant set T, we prove that under appropriate hypothe- 
ses, r is the graph of a C r function and thus a C r manifold. Because the 
hypotheses can be easily verified by inspecting the vector field of the system, 
this invariant manifold theory can be used to study the existence of invariant 
manifolds in systems involving a wide range of parameters and the persistence 
of invariant manifolds whose normal hyperbolicity vanishes when a small pa- 
rameter goes to zero. We apply this invariant manifold theory to study three 
examples and in each case obtain results that are not attainable by classical 
normally hyperbolic invariant manifold theory. 
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1. Introduction 
Consider the following ordinary differential equation 
(1.1) x = F(x), 

where ' = 4r, x £ R n , and F is C r for some r > 1. Let <!>(£, x) be the flow generated 



by (1.1 1. Suppose M is a C r invariant manifold of (1.1). Following the work of 
Fcnichcl [9 , a simple version of normally hyperbolic invariant manifold theory can 
be roughly stated as follows: if there is a continuous splitting of the tangent bundle 
of R n restricted to M: TR n \ M = TM®N S ®N U such that (1) TM®N S and TM® 
N u are invariant under D x <5>(t, M) (i.e., the linearization of <f>(t,x) at M) and (2) 
D x <&{t, M) expands N u and contracts N s at rates at least r times of its expansion or 
contraction rate in TM (r -normal hyperbolicity), then M has a C r stable manifold 
W S (M) tangent to N s along M and a C r unstable manifold W U (M) tangent to 
N u along M, and the manifolds M, W S (M), and W U (M) all persist with the same 
C smoothness under any sufficiently small (in C 1 norm) C r perturbation of the 
vector field F . Here, we have omitted some technicalities such as the overflowing 
or inflowing invariance of M (if it has a boundary) and the local invariance of 
W S (M) and W U (M). We refer readers to the work of Fenichel [3] and an extensive 
exposition by Wiggins |19j for the precise description of the theory and many other 
properties of normally hyperbolic invariant manifolds. Equivalent results can also 
be found in the work of Hirsch, Pugh, and Shub [14] . A generalization to the case 



that M is an invariant set of ( 1 . 1 1 is given by Chow, Liu, and Yi in [5] , where the 
authors proved the existence of center-stable, center-unstable, and center manifolds 
of M and their persistence under small perturbations. In [3], Bates, Lu, and Zeng 
developed a normally hyperbolic invariant manifold theory for C 1 semiflows in 
general Banach spaces. They also provided a thorough review on the extensive 
history of invariant manifold theory. 

The persistence of normally hyperbolic invariant manifolds can be applied to 
establish the existence of invariant manifolds in systems in the form of 

(1.2) x = F (x) + eF 1 (x,e) 

provided that for the corresponding "unperturbed" system x — Fq(x), the exis- 
tence of an "unperturbed" normally hyperbolic C r invariant manifold M$ is al- 
ready known. In particular, if Mq is r-normally hyperbolic and the C 1 norm of the 
function x i— > Fi(x, e) is 0(e) for e — > + , then a C r invariant manifold M e , which 



is the perturbed counterpart of M , exists for (1.2 1 with any e € (0,eo] provided 
that eo is sufficiently small. However, it can be a difficult task to verify the normal 
hyperbolicity of Mq since the precise knowledge about Mo and the linearization of 
the unperturbed flow at Mq is not attainable in many applications. Furthermore, 
because normally hyperbolic invariant manifold theory does not provide any further 
information about the size of eo other than being sufficiently small, we do not know 
to what extent the persistence result holds. 

In this paper, we present a new theory on the existence of C r invariant manifolds 
in systems of ordinary differential equations. Two special features of this new 
invariant manifold theory are: its hypotheses can be verified by inspecting the 
vector field instead of the flow of a specific system; and for systems depending on 
parameters, it provides a feasible way to compute the parameter ranges in which the 
desired invariant manifold results can be guaranteed. With these features, this new 
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theory can work with systems that require delicate analysis of the perturbations 
involved as well as systems that cannot be treated as perturbation problems, and 
in both cases, it establishes results that are not attainable by classical invariant 
manifold theory. 

1.1. Main Results. We consider the following system 

a = f(a, z) , 

(1.3) . 

z = g(a,z) , 

where ' = 4: and (a, z) 6 W 1 x R m . For notational convenience, we define x := (a, z) 
and X := K n x M. m . For any function defined on a subset of X, we use x and (a, z) 
interchangeably to denote its argument, e.g., f(x) = /(a, z), and g(x) — g{a,z). 

Suppose that / and g are at least C 1 on an open domain U C 1" x W n . Then 
(1.3 1 generates a flow $(t,x) on [7 even though for some x £ U, $(t,x) may not 
be defined for all t £ R. For a subset of U, we define its positive invariance under 
the flow $ as follows: 

Definition (Positive Invariance). r C U is positively invariant under $ if 

(1) for every x £ T, $(t, x) is defined for all t > 0; and 

(2) $(i,T) C T for all f > 0. 

First, we consider under what circumstances a positively invariant set T is a 
C 1 manifold. Let (• , •) denote the usual Euclidean inner product, and let || ■ j 
denote the usual Euclidean norm as well as the induced operator norm. For each 
x = (a, z) 6 X and d > 0, let M^x) be a closed box neighborhood of x: 

M d (x) := {(a',z') £ X : \\a' - a\\ < d, \\z' - z\\ < d} . 

In addition, define £:IxI^Ras follows: 

(1.4) £(x 1 ,x 2 ) := 1 1 a 2 - ax|| 2 - \\z 2 - zi|| 2 , 

where x± = (ax,z\) and x 2 — {a,i,z-i)- Then for each x £ X, we define the cone 
with vertex x as follows: 

(1.5) C(x) := {x' £ X : C(x' , x) > 0} . 

Hypothesis 1. U is an open, convex subset of M n x M m . In addition, there exists 
a d > such that C(x) f] U C M d (x) for all x £ U. 

Hypothesis 2. / and g are C 1 on U. Furthermore, there exist a continuous, 
positive function a : U — * M, a continuous, nonnegative function i : U — » K., and a 
constant c\ > smc/i i/iai 

(1.6a) (a 1 , D a f(x) a') > a(x)\\a'\\ 2 for any x £ U and any a' £ M. n , 

(1.6b) {z',D z g{x)z') < ^(x)||z'|| 2 for any x £ U and any z' £ R m , 

(1.6c) a(x) > £(x) + \\D z f(x)\\ + \\D a g(x)\\ + a for all x£U. 

Define the following projections: 

LT : (a, z) a , 
: (a, z) i— » z . 



Hypothesis 3. T C U is positively invariant under the flow of (1.3) and satisfy 
T1 ± (T) = n x (C7) C W m . 
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Theorem 1.1. Suppose Hypotheses\^\^ and^hold. Let K := IL(r) = U ± (U). 
Then T contains all positively invariant subsets of U, and there exists a C 1 function 
h : K -> R™ such that V = {{h{z),z) : z e K). Moreover, \\h(z 2 ) - h(z{)\\ < 
\\ z 2 ~ for any z\, z 2 £ K with Z\ ^ z 2 , and \\Dh(z)\\ < 1 for all z E K. 

Next, we consider the further smoothness of a positively invariant set T if we 
know a priori that T is the graph of a C 1 function from an open subset of R m to 
R". 

Hypothesis 4. Kq is an open, convex subset of R m . h a : K Q — » R™ is C 1 , and 
£/iere exists an rj > smc/i £/iai ||D/io(^)|| < ?7 /or all z E -ftTo. 

Hypothesis 5. There exists an open neighborhood Uq of {(ho(z),z) : z € /-Co} 
swcft i/iai / and g are C r (r > 2) with their first to r-th derivatives all bounded 
on Uq. Furthermore, there exist a continuous, positive function a : Uq — > R, a 
continuous, nonnegative function I : Uq — > M. and a constant c r > smc/i i/ia£ 

(1.7a) (a , D a f(x) a 1 ) > ||a'|| 2 /or any x € t/o and any a' € R™, 

(1.7b) {z',D z g(x)z') < ^(x)||z'|| 2 /or any x e J7q and any z' E R m , 

(1.7c) a(x) > r£(x) + (r + l)»j||D fli(a:)|| + c r for all x S t/ - 

Theorem 1.2. Suppose HypothesesU and^hold. If T — {(h (z),z) : z € A' } is 
positively invariant under the flow of (l.cfy , then ho : Kq — > R™ is C r with its first 
to r-th derivatives all bounded on Kq. 

It is evident that the combination of Theorem 11.11 and Theorem 11.21 establishes 



the existence of a C r positively invariant manifold for (1.3 1. Specifically, take 
Uq = U , h = h, and 77 = 1. Then by replacing Hypothesis [2j with a stronger one, 
we obtain a C manifold theorem. 

Hypothesis [2]*. / and g are C (r > 2) with their first to r-th derivatives all 
bounded on U . Furthermore, there exist a continuous, positive function a : U — > R, 
a continuous, nonnegative function I : U — ► R, and constants C\, c r > such that 

(a' , D a f(x) a') > a(a;)||a'|| 2 /or any x&U and any a 1 S R™, 

(z', D z g(x) z') < l(x)\\z'\\ 2 for any x EU and any z' E R m , 

a(z) > %) + ||-D z /(x)|| + \\D a g(x)\\ + c x for all xEU, 

flUfe ) a(x) > r£(ar) + (r + l)||D g(a;)|| + c r for all xEU. 

Theorem 1.3. Suppose Hypotheses^ [If, and[^ftoZd Le£ A := n^(r) = n^(C/). 
Then T contains all positively invariant subsets of U, and there exists a C function 
h : K -> R" sucft that V = {(h(z),z) : z E K). Moreover, \\h(z 2 ) - h{z x )\\ < 
\\ z 2 — z\\\ for any Z\, z 2 € K with Z\ 7^ z 2 , \Dh[z)\ < 1 for all z E K, and all 
higher derivatives of h are bounded on K. 

To apply Theorem |1.1| or Theorem |1.3| to establish invariant manifolds for a 
given system of ordinary differential equations, we need to carry out the following 



five steps. The first step is to reformulate the system into the form of (1.3 1. It is 
often necessary to change variables and append auxiliary parameters. In particular, 
appropriate rescaling of variables can lead to sharper results from the inequalities 



1.6c[) and ( 1.6 i). The second step is to select a domain U that satisfies Hypothesis 



111 Sometimes, it is necessary to choose a family of candidate domains that depends 
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on some parameters and then determine the parameters or their ranges in later 
analysis. The third step is to verify Hypothesis [3] Very often we define T C U to 
be the set of points whose images under the flow of the reformulated system stay in 
U forever in forward time so that L is positively invariant by definition. In addition, 
this definition of L allows us to verify n^(L) = H ± (U) by simply inspecting the 
topological properties of the vector field at the boundary of U and then applying an 
elementary topological argument — the Wazewski principle (see Appendix DSJ. The 
fourth step is to verify Hypothesis [2] or [2j* . Especially, using the inequalities (1.6c) 
and (1.61), we can estimate the set of admissible parameter values for the system 
or derive concrete, computable criteria for the smallness of perturbations. In the 
last step, we switch from the reformulated system back to the original system and 
identify the manifold that corresponds to P. Another advantage of the definition 
of r introduced in the third step is that it allows us to easily establish important 
properties, which may include uniqueness, full invariance (both forward time and 
backward time) , independence of the rescaling of variables in the reformulation of 
the system (in the first step), periodicity with respect to some variables, etc., for the 
manifold in the original system. In Section [3] we will illustrate all these five steps 
and the relevant technical arguments in detail with three examples. Specifically, the 
first example is not a perturbation problem and involves a wide range of parameter 
values, and the other two examples are related to the problem of weak hyperbolicity, 
which will be discussed in the next subsection. 

Traditionally, proofs of invariant manifold theorems are based on either one 
of two complementary methods: Hadamard's graph transform method, and the 
Liapunov-Perron method. Both methods require the construction of a contraction 
in some Banach space such that its fixed point is a function whose graph is a Lips- 
chitz invariant manifold. However, their approaches to constructing such a contrac- 
tion are different. Specifically, the graph transform method obtains a contraction 
using the invariance of the manifold's graph representation under a time-T map 
generated by the flow, whereas the Liapunov-Perron method achieves a contrac- 
tion by setting up an integral equation using the variation of parameters formula. 
To prove the C 1 smoothness of the manifold, one constructs another contraction 
by formally differentiating the corresponding functional equations and then proves 
that its fixed point is in fact the desired derivative. If further smoothness is needed, 
one repeats this procedure inductively to show that the manifold is C r smooth. 

Alternatively, without referring to any contraction, one can establish invariant 
manifold results through a mixed use of invariant cones and topological arguments, 
an idea which, according to Jones [TS], was introduced by Charles Conley. In [T5] . 
Jones used this method to construct a Lipschitz invariant manifold in a singularly 
perturbed slow-fast system. He also gave a very brief outline for showing the C 1 
smoothness of the manifold. In an earlier reference |18j . based on the same mixed 
use of invariant cones and topological arguments, McGehee supplied a proof of 
a C r local stable manifold theorem for a fixed point of a hyperbolic linear map 
plus a nonlinear term that is small in C' r norm. In addition, Bates and Jones 
j2] extended this method to an infinite-dimensional setting to construct Lipschitz 
invariant manifolds for a semilinear partial differential equation. 

In this paper, the proof of Theorem |1.1[ which consists of two parts — the Lips- 
chitz smoothness and the C 1 smoothness of L, is based on the mixed use of invari- 
ant cones and topological arguments. In fact, the Lipschitz smoothness part of the 
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proof closely follows the relevant part of the proof given in [15]. However, in the C 1 
smoothness part of the proof, we introduce a new strategy for combining invariant 
cones and topological arguments. Specifically, we first construct a vector bundle 
over r such that it is invariant under the linearized dynamics along T and also sat- 
isfies some desirable topological and dynamical properties, and then we show that 
this vector bundle is in fact the tangent bundle of T. This approach is completely 
different from what is described in the outline for showing C 1 smoothness in |15j 
and what is given in the relevant part of the proof in |18j . The main technical 
issue is that the strategies used in [TS1 HE] rely on the assumption of "sufficient" 
C"*-smallness of certain terms (or perturbations) and thus are not applicable in our 
case, where the corresponding boundedness conditions are given explicitly by the 



inequality ( 1.6c I 



In the proof of Theorem |1.2| for the C r smoothness of T, we also introduce a new 
inductive scheme, which utilizes the hypothesis that the manifold is known to be 
the graph of the C 1 function Hq. We show that in an appropriate coordinate system, 



along any solution trajectory of (1.3 1 on T the dynamics of the derivative Dho are 
governed by a system in the form of ( 1.3 1. This allows us to apply Theorem |1.1| to 



show that DIiq is C 1 and thus h is C l . Once again, by choosing an appropriate 
coordinate system, we can express the dynamics (along any solution trajectory of 
(1.3 1 on r) of the second derivative D 2 tiQ by a system in the form of (1.3 1. Then 



we proceed inductively to establish the C r smoothness of ho. 

1.2. The Problem of Weak Hyperbolicity. Although the invariant manifold 
theory presented in this paper has a wide range of applications, the initial motiva- 
tion for this work is to study the persistence of invariant manifolds whose normal 
hyperbolicity is "weak" in the sense that it depends on a small parameter and 
vanishes as the parameter goes to zero. Specifically, consider the system 

w^eF 1 (w) + e 2 F 2 (w,9,e), 

1 ' 9 = GoM + ediw) + e 2 G 2 (w, 9, e) , 

where w G K™, 9 G T m , < e <C 1, and all functions on the right-hand side are C 



(r > 1) with respect to their arguments. Systems in the form of (1.8) often arise 



in situations involving averaging. In particular, in view of the absence of 9 in the 



0(1) and 0(e) terms, (1.8 1 can be regarded as the result of a first-order averaging 
procedure applied to a near-integrable system which is formulated in action-angle 
variables. In this case, the equation w = eF\(w) is usually referred to as the 
averaged equation, and studying the dynamics of it is the first step to understand 



the dynamics of the full system ( 1.8 1. Suppose a C r invariant manifold M C K™ is 
identified for the averaged equation w = eFi(w). It follows that M x T m is a C r 
invariant manifold in the truncated system 

w — eFi(w) , 

(1.9) 

6 = G {w) + eGi{w) . 



Then the immediate question is the persistence of M x T™ 1 in the full system ( 1.8 1, 
which includes the 0(e 2 ) terms. However, this is a nontrivial problem even under 



the assumption that M x T m is normally hyperbolic with respect to (1.9 1 for any 
fixed e G (0, eo] with eo being some positive constant. In particular, when we 
consider any fixed e G (0,e ], h is unclear whether or not the 0(e 2 ) terms are 
"sufficiently small" in C 1 norm so that the aforementioned persistence of normally 
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hyperbolic invariant manifolds applies. On the other hand, as we reduce the G 1 
norm of the 0{e 2 ) terms by reducing e, the "strength" of the normal hyperbolicity 



of M x T m with respect to ( 1.9 ) is also weakened since the hyperbolicity is generated 



by the 0(e) term zF\(w). In the limit e — > + , the normal hyperbolicity of Af x T' 



with respect to (1.9 1 fails as eFi(w) vanishes. This situation is referred to as weak 
hyperbolicity of the manifold M x T ro (11] [15). We also say that M x T m is only 
weakly normally hyperbolic with respect to (|1.9|. Note that by rescaling 9 and time, 



we can obtain a variant of ( 1.8 1 and correspondingly a variant of (1.9 1, with respect 
to which the normal hyperbolicity of M x T m no longer depends on e. However, 
the problem remains as other forms of singularities occur after rescaling variables. 
See [5] for the related discussions. 

In [19j . Wiggins adapted a continuation argument, which was originally proposed 
by Kopell [T7] for a different class of systems, to show the persistence of M x T m 



in (1.8) for the case that m > 1 and M is an attracting fixed point of w = eF±(w). 



Specifically, fix e > 0, and rewrite (1.8 1 as a one-parameter family of systems 



to = eFi(w) + a 2 F2(w, 8, a) , 
' ' " 10 ' 9 = GoM + eGi(u>) + a 2 G 2 (w, 9, a) 



where a € [0, e] is an auxiliary parameter. When a — 0, (1.10 1 reduces to (1.9 1, 
under the flow of which M x T m is normally hyperbolic by the assumption that 
M is an attracting fixed point of w — eFi(w). Then the persistence of normally 
hyperbolic invariant manifolds implies that there exists an a\ G (0, e] such that 



for any a G [0,ai], (1.10 1 has an invariant torus A4 a which is a perturbation of 



Mo := M x T m . Note that if A4 ai is normally hyperbolic with respect to (1.10) 
with a = c*i, then ot\ can be increased to some a 2 G (ct\, e] such that Ai a exists for 
any a £ [0, a 2 \- Now the question is whether or not this process can be repeated so 
that the family of invariant tori {-M Q } can be continued for all a € [0, e]. In [T3] 
(pp. 168-170), Wiggins derived upper estimates of the generalized Lyapunov-type 
number^] of A4 a . Then he argued that for sufficiently small e > 0, those upper 
estimates are bounded below the required critical values uniformly for all a € [0, e] 
and thus Ai a exists and remains normally hyperbolic for any a G [0, ej. 

This continuation argument was then used as a general strategy for establishing 
the persistence of weakly normally hyperbolic invariant manifolds in several dif- 
ferent model systems (see, e.g., [El HI])- However, Chicone and Liu subsequently 
pointed out in [5] that this argument contains a conceptual gap because it fails 
to address the issue that the uniform boundedness of the generalized Lyapunov-type 
numbers does not guarantee uniform normal hyperbolicity for a continuous family of 
normally hyperbolic invariant manifolds. Referring to the example discussed above, 
the technical issue can be described as follows. By extending the interval [0,ai] 
to [0,a2] and continuing in the same way, we can obtain an increasing sequence 

■'"We refer readers to the references [9] 1191 for the technical definitions of generalized Lyapunov- 
type numbers. Roughly speaking, under the linearized dynamics along a trajectory on the invariant 
manifold M , the generalized Lyapunov-type numbers measure the expansion and contraction rates 
in the bundles N u and N s and compare these rates with the expansion or contraction rate in the 
tangent bundle TM. Thus, the invariant manifold M is normally hyperbolic if (1) M is C smooth 
for some r > 1, (2) it admits the splitting TR"\ M = TM N s © N u which satisfies the required 
invariance condition, and (3) the generalized Lyapunov-type numbers of M are bounded below 
certain critical values. Note that (1) and (2) are required so that the generalized Lyapunov-type 
numbers of M can be defined. 
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{ai, a2, «3, ...} such that M a exists for any a £ [0,aj with % = 1,2,3,.... How- 
ever, if {ai, ct2, 0.3, ...} converges to a limit a* < e, we can only conclude that M a 
exists for any a £ [0,a*). In order to continue the family of tori {.M Q } for a > a* , 
we must establish the existence of a normally hyperbolic invariant torus M a * for 



(1.10 1 with a — a* . Unfortunately, even if the generalized Lyapunov-type numbers 
of M. a are bounded below their critical values uniformly for all a £ [0,a*), the 
existence of M. a * cannot be guaranteed because M. a may still lose normal hyper- 
bolicity in the limit a — > a*~ by losing smoothness localljj^Jor losing the splitting 
T(R" x T n )\ Ma = TM a ffi N s 8 N u localljQ In particular, since the general- 
ized Lyapunov-type numbers only reflect the global characteristics of the linearized 
dynamics along the invariant manifold, their uniform boundedness alone is not 
sufficient to rule out these local "defects" . Note that although the expressions of 
the upper estimates used in the continuation argument may remain defined and 
bounded below the required critical values for a > a* , they no longer have any 
significance since the corresponding generalized Lyapunov-type numbers are not 
even defined before we actually establish the existence of M. a for a > a* . 

Technically, the presence of the conceptual gap in the continuation argument does 
not imply that the result achieved by this argument is necessarily false. However, 



the assertion in [TI5] that an attracting invariant torus A4 a exists for (1.10 1 with 
any a £ [0, e] if e is sufficiently small is in fact untrue, and so is the claim that 
for a sufficiently small e > 0, certain upper estimates of the generalized Lyapunov- 
type numbers of M a are bounded below the required critical values uniformly for 
all a £ [0, e]. Indeed, it is possible that the generalized Lyapunov-type numbers 
converge to their critical values at some a < e no matter how small e is. To see 



this, consider the following simple example, which is a particular case of (1.8 1: 

w = — ew + a 2 sin 9 , 

(1.11) 

e = w, 

where w £ R, 9 £ T 1 , < e -C 1, and a £ [0,e]. Clearly, for any fixed e > 0, 
w = is an attracting fixed point of w = —ew, and A4o — {(0,9) : 9 £ T 1 } is a 
normally hyperbolic invariant 1-torus for ( |1.11[ ) with a = 0. However, no matter 
how small e > is, ( |1.11[ ) with a — e has two fixed points, which are a saddle 
point at (0,0) and a stable spiral at (0,7r), and thus possesses no invariant 1-torus. 
Furthermore, in this example the generalized Lyapunov-type numbers of M. a do 
reach their critical values as a converges to from below, and the family of C 1 
1-tori {A^ q } only exists for a £ [0, |e). 

The above counterexample also suggests that we should not expect the general 



persistence of weakly normally hyperbolic invariant manifolds in (1.8 1 and instead 
we should formulate additional hypotheses about the system in order to establish 
the desired invariant manifold results. For example, let M be a hyperbolic fixed 

2 In [5], Chicone and Liu presented a scenario that a family of normally hyperbolic limit cycles, 
with their generalized Lyapunov-type numbers uniformly bounded below the required critical 
values, cannot be continued further as the family converges to a nonsmooth homoclinic loop. 

■^In |13| . Haro and de la Llave studied continuation of invariant tori for quasi-periodic per- 
turbations of the standard map. They numerically observed and analyzed a situation that a 
one-parameter family of normally hyperbolic invariant 1-tori, with their generalized Lyapunov- 
type numbers uniformly bounded below the required critical values, cannot be continued further 
as the subbundles N s and TV" converge locally when the continuation parameter approaches a 
critical value. We remark that similar examples can also be constructed for flows. 
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point or a hyperbolic periodic orbit of the averaged system w = eF\(w). Suppose 
9 G T 1 and Gq(w) ^ for any w G M. Then MxT 1 persists in (1.8 1 as ahyperbolic 



(1.12) 



periodic orbit or a hyperbolic torus (see, e.g., [II El EH])- In addition, Chow and Lu 
[7J studied a particular form of (1.8 1: 

to = eFi(w) + e 2 F 2 (w,9,e) , 

9 = B + ediw) + e 2 G 2 (w,8,e) , 

where 9 G T m and the frequency vector Qq is constant. For the case that M 
is a fixed point of w = eFi(w) with center-stable, center-unstable, and center 
manifolds W CS (M), W CU (M), and W C (M), respectively, they proved the persistence 
of W CS (M) x T m , W CU (M) x T m , and VF C (M) x T n in ( [l~T2| for su fficien tly small 
e > 0. In [5], Chicone and Liu studied a 3-dimensional system (see (4.10 1 ) which, 
by rescaling an angular variable and time, can be put into the following form: 



(1.13) 



w = eFi(w) + e 2 F 2 (w,9,e 2 ) 
9 = 1. 



where to G 1R x T , G T , and e is the square of the original small parameter used 
in [5] . Chicone and Liu proved that if M is an attracting or repelling limit cycle of 
ib = eFx(w) then M x T 1 persists in (1.13) for sufficiently small e > 0. Note that 
the perturbation is 0(e 2 ) in this case. 

In Subsection |4.3| we will study the following system 

w = eFi{w) + e 1+ »F 2 {w, 9, e) , 

' ' ' 4 ' 9 = 6 + e u Gx(w, e) + e 1+ ~<G 2 (w, 9, e) , 

where w G R n , 9 G T m , a > 0, 7 > 0, 1 > v > 0, and a + v > 1. Note that 



both (1.121 and (1.131 are special cases of (1.141. Specifically, we have fi = 1 



7=1, and v = 1 for (1.121 and jj, = 5, 7 = 1, and v = 1 for (1.131 (considering 



1.1 



and Theorem 



1.3 



to show that if 



persists in (1.14) 



9 = 1 + eO + e 2 0). We will apply Theorem 
M is a hyperbolic periodic orbit of w = eF\(w) then MxT 
for sufficiently small e > (see Theorem |4.4[ ). The crucial difference between 
(1.14 1 (or its special cases ( |1.12[ ) and ( 1.13[ )) and ( |1.11[ ) with a = e is that for the 
latter case, /1 = 1 and z/ = and thus the inequality [i + 1/ > 1 is not satisfied. 
Finally, we mention that in Subsection 4.2 we will study ( | 1 . 1 3 ) in its original form 
in [5] and solve an open problem posed by Chicone and Liu. In particular, by 
applying Theorem |1.1| and Theorem |1.3| we will formulate a sufficient condition 
for the existence of a C r invariant torus without assuming the existence of any 
unperturbed invariant torus. 

1.3. Organization. The balance of this paper is organized as follows. The com- 
plete proofs of Theorem |1.1| and Theorem |1.2| are given in Section [2] and Section[3l 
respectively. Then we illustrate the applications of Theorem |1.1| and Theorem |1.3| 
with three examples in Section [4] At the end of this paper, a concise statement of 
the Wazewski principle is included in Appendix |A} 

2. Proof of Theorem 11.11 

2.1. The Existence and the Lipschitz Continuity of h. In this subsection, we 
prove that there is a Lipschitz function h : K — > R n such that the graph of h is T. 



We achieve this goal in three steps. In the first step (Lemma 2.1|, we establish the 
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"invariance" of the "moving cones" C(<5>(t,x)), which move in translation as their 
vertices move under the flow $ in forward time. In the second step (Lemma 2.2 1, 
we show that trajectories in these cones drift away from the moving vertices at least 
exponentially fast in forward time. In the third step (Lemma 2.3 1, we establish the 



existence and the Lipschitz continuity of h using Lemmas |2 . 1 1 and 2.2 Throughout 
this subsection, we will use the following notations for any xx, x% £ U: 



(a 1 (t),zi(t))=x 1 (t) 
(a 2 (t),z 2 {t))=x 2 (t) 
(Sa(t),5z(t)) = 6x(t) 



$(t,SBi), 
X 2 {t) - Xx(t) 



In addition, taking account of the convexity of U, we define the functions L/. a , 
Lr L„ „, and L„ all mapping U x U into R, as follows: 



(2.1) 



Lf >a {x\, x 2 ) := J^a(xi + s(x 2 - xi)) ds , 
Lf, z (xi, x 2 ) := J Q \\D z f{xx + s{x 2 - x{))\\ ds . 
L 9 m{xi,x 2 ) := J Q \\D a g(xi + s(x 2 - x{))\\ ds . 
L g , z (xi,x 2 ) := Jq£(x 1 + s{x 2 - xx)) ds . 
Then it follows from (1.6a) and ( |1.6b ) of Hypothesis [2] that 



(2.2) 



(6a, 6a) > L fia (xi,x 2 )\\6a\\ 2 - L f . z (xi,x 2 )\\6a\\\\6z\ 



(6z,6z) < Lg )a (5i,i 2 )||^a||||^|| + L g , z (x 1 ,x 2 )\\6z\\ , 
whenever x\(t) € U and x 2 (t) G U. 

Lemma 2.1. For any X\, x 2 € U and t > 0, if x 2 £ C(xi), $([0, to], Xx) C U, 
and $([0,t ],x 2 ) C U, then x 2 {t) £ C{xi{t)) for all t £ [0,t ]. 

Proof. The lemma is trivially true for x\ = x 2 £ U. Thus, we only consider x\, 
x 2 £ U with xx 7^ x 2 . Then Xx(t) ^ x 2 (t) for all possible t due to the uniqueness 
property of the solutions of (1.3) inside U. Suppose that $([0, to\,Xx) C U and 
$([0,ta],x 2 ) C U for some i > 0. 

Assume that x 2 (t) £ C(xx(t)) for some r £ [Q,io]. Then ||i5z(r)|| < ||<5a(r)|| by 
(1.4 1 and (1.5 1. Incorporate this relation into (2.2 1. It follows that 

(2.3a) (fc(T),fa(r)) > (L /i( ,(5i(r), x 2 (t)) - L f<z {xx{r), S 2 (r))) ||M^)I| 2 > 

(2.3b) (6z(t),6z(t)} < (L s , a (£ 1 (r),5; 2 (T)) + L 9 , 2 (5; 1 (T),£ 2 (T)))|| ( 5a(T)|| 2 . 

Combining the above two inequalities and using (2.1) and ( 1.6c [ I, we obtain 

(6a(T),6a(T)) ~ (6z(t),6z(t)) > Cl ||(5a(T)|| 2 . 

Thus, for any r £ [0,t ] such that x 2 (t) £ C(x\(t)) (i.e., C(x 2 (t), xx(t)) > 0), 
we have that 

(2.4) [f t C(x 2 (t),Xx(t))]^ T > 2 Cl ||<5a(r)|| 2 > 0, 

where the second (strict) inequality is assured by ||<5a(r)|| > 0, a fact due to Xx( r ) 
x 2 (t) and ||<5a(r)|| > ||<5z(t)||. Now consider x 2 £ C(xi). Then 

(2.5) C(x 2 (0),xx(0)) >0, 



and with r = 0, (2.4 1 becomes 

(2.6) [£ t £(x 2 (t),xx(t))]^ o >0. 
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Altogether, (f274|>— (f2l6|> imply that C(x 2 (t), Xi(t)) > for all t G [0,t ] if x 2 G 
C( Xl ). □ 

We now demonstrate that inside the moving cone C(5>(i, x)), trajectories drift 
away from the moving vertex <!>(£, x) at least exponentially fast in forward time. 

Lemma 2.2. For any x\, x 2 G U and t > 0, if x 2 G C(xi), &([Q,to\,xi) C U, 
and &([0,to],X2) C U, then \\a 2 (t) - 5i(i)|| > \\a 2 - ai|| e Clt for all t G [0,t ]. 

Proof. Take x\, x 2 G U and t > such that <f>([0, t ], xi) C U and $([0, fo], x 2 ) C 
C/. Assume that x 2 (r) G C(xi(t)) for some r G [0,< ]- Recall (2.3a I, and note that 
Lf ta (x,x') — Lj\ z (x,x') > c\ for any (x,x') G U x U by ( 1.6c I. Then we have 

(2.7) [f t \\~a 2 {t) a a (t)|| 2 ] t=T > 2 Cl ||a 2 (r) - 5i(r)|| 2 . 



Now consider x 2 G C{x\). By Lemma 2.1 i 2 (r) G C(xi(r)) for all r G [0,to]- 
Thus ([2J| holds for all r G [0,t ]. It follows that ||5 2 (*) - ai(t)\\ > \\a 2 - a x || e Cl * 
for all t G [0, to]. □ 



Having established Lemmas 2.1 and 2.2 we now show that T is the largest 
positively invariant subset of U and it is the graph of a Lipschitz function h : K — > 



Lemma 2.3. T contains all positively invariant subsets of U , and there exists a 
Lipschitz function h : K — > W 1 such that T = z) : z G if}. Moreover, 

\\h(z 2 ) — h(zi)\\ < \\z 2 — Z\\\ for any z\, z 2 G K with Z\ ^ z 2 . 

Proof. Let V be the union of all positively invariant subsets of U. Consider xi, x 2 G 
r' with x\ ^ x 2 . First, we prove x 2 ^ C(x\) by contradiction. Suppose x 2 G C{x\). 
Since V is positively invariant, <I>([0, t ], ^i) CT'C{/ and $([0, to], x 2 ) cfCd 
for all t > 0. Applying Lemma [2. 2[ we obtain that for all £ > 0, 



||a 2 (£)-ai(£)|| > \\a 2 - ai \\ e Clt . 

In addition, \\a 2 — a±\\ > since x\ ^ x 2 and \\a 2 — a\\\ > \\z 2 — Z\\\ for x 2 G C{x\). 
Thus, || a.2 — e Clt increases exponentially (as opposed to being constant 0) for 
t > 0. On the other hand, Lemma [2. 1| implies that x 2 (t) G C{x\{t)) for all t > 0. 
Then it follows from Hypothesis [l] that ||a 2 (i) — 5i(£)|| < d for all t > 0, which 
constitutes a contradiction. 

It follows that for each x G V, C(x)f]T' = {x}. Since if = n^(r) = U ± (U) by 
Hypothesis [3] and n^(r) C U ± (T') C n i (C7), we have that n ± (L) = if. Then for 
each z G K there is a unique x z = (a z ,z) G T' such that H ± (x z ) = z. Thus, we 
can define a function h : K —> M n by letting /i(z) := a z for each z G K. Obviously, 
r' = {{h(z),z) : z G if}. In addition, we have r = T' since n^(r) = II j.^) = if. 

Next, we consider x± — (h(z\),Zi) and x 2 — (h(z 2 ),z 2 ) for any z 1; z 2 G if with 
zi ^ Z2. Since x\, x 2 G T and xi ^ x 2 , we have x 2 ^ C(xi). Then it follows from 
flO) and (ITsf that ||/i(z 2 ) - ft(«i)|| < ||z 2 - zi||. □ 



2.2. The C 1 Smoothness of h. We need to work with the variational equation 
of ( 1.3 1 along trajectories in T. Rewrite ( 1.3 1 in a compact form: x = F{x), and let 
and x = (a, z) G X be the variations of a, z, and x, respectively. 



a G 



Z G 



Then the variational equation of (1.3) along a trajectory <i>(i, x) for any x G T is 
given by 

(2.8) x = DF($(t,x))x, 
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where t > and i£T now serves as a parameter. 



For the linear system (2.8 I with any parameter x G T, the solution that originates 
at x at t = can be represented as Q{t, x) x, where Q(t, x) is a linear transformation 
of X to itself for each fixed t > with Q(0, x) — I being the identity transformation 
of X. Note that for / and g that are C 1 on U, DF($>(t,x)) depends on (t,x) 
continuously on [0, oo) x T. Then for each fixed x G V, Q(t,x) is defined for all 
t > 0, and furthermore, the map (<, i— > Q(i, a;) is continuous on [0, oo) x T. 



It is important to note that Q(t,x) x is not a flow on X since the system (2.8) 
is nonautonomous. However, for (t, x) G [0, oo) x T, the family of linear transfor- 
mations Q{t,x) forms a cocycle over the flow x), i.e., for any t, t G [0,oo) and 

x e r, 



(2.9) 



Q(0,x)=I, 
Q(t + t, x) = Q(t, $(t, x)) o Q(t, x) . 



Note that our construction of cones in X still applies when using the variational 
variable x — (a,z), i.e., 

(2.10) C(x u x 2 ) = \\a 2 - ai \\ 2 - \\z 2 - Zl \\ 2 , 

(2.11) C(x) = {x' e X : C(x',x) > 0} . 

Let be the zero vector in X. For each x GT, define the set T(x) as follows: 
T(x) := {x € X : Q{t,x) x <£ int(C(0)) for all t > 0} 
= {x G X : C(Q(t, x) x, 0) < for all t > 0} . 
Obviously, G T(x), and the image of T(x) under the linear transformation Q(t, x) 



(2.12) 



does not intersect int(C(0)) for any t > 0. In addition, it follows from (2.9 1 that 
for any x G T(x), 



(2.13) 



Q(t, x)xG T($(t, x)) for all t > . 



The outline of the proof of the C 1 smoothness of h is the following. In 2.2.1 



we 



will first show that for each x GT, T(x) is in fact a linear subspace of X and it can 
be represented as the graph of a linear operator H(x) : W n — * R n . Then we will 
demonstrate in 2.2.2 that the map x i— ► H(x) is continuous for all iGf. Finally, in 



2.2.3 we will show that H(h(z), z) is indeed the derivative of h at z for any z G K. 



2.2.1. T(x) is a linear subspace of X. Consider (2.8| in terms of (a, z), i.e. 

d = D a /($(t, x)) a + £>,/($(t, x)) z , 
z = D a g{$>{t, x)) a + D z g(®(% x)) z . 



(2.14) 



Applying ( 1.6a I and ( 1.6b I , we obtain the following inequalities: 

(2.15a) (o,d) > a($(t,s))||a|| 2 - ||D,/($(t,aO)||||a||||z|| 

(2.15b) (z,z) < \\D a9 m,x))\\\\a\\\\z\\ + em,x))\\z\\ 2 . 



which are similar to ( 2.2 1 . In addition, for any x € T, both inequalities of (2.15) 



hold for all t > since $(t, x) eT dU for all t>0. 



The next three lemmas are simple consequences of (2.15) 



Lemma 2.4. For any x 6 T and any x G C(0), Q(t,x) x G C(0) for all t > 0. 



AN INVARIANT MANIFOLD THEORY FOR ODES AND ITS APPLICATIONS 



13 



Lemma 2.5. For any x € T and any x £ C(0), 

||n(Q(f, a;) as) || > ||II(x)|| e /o(«»(*(».*))-ll^/(*(«^))ll)* f or all t > 0. 
We omit the proofs of Lemma |2.4| and Lemma |2.5| since they are essentially the 



same as the proofs of Lemma 2.1 and Lemma 2.2 respectively. A difference here is 
that we only consider xeT. Thus the statements of Lemma [2. 4| and Lemma [2~5 
can be shown true for all t > (as opposed to only for t £ [0,t ]). 
By ( 1.6c| ) , we have that for any (t, x) € [0, oo) x T, 

(2.16) a($(*,x)) - ||D,/($(t,a;))|| > a + ||£> off ($(t,i))|| +*($(«,*)) . 

implies that for any x € T and x 6 C(0) with a; ^ 0, ||n(Q(t, x) x) II 



2.5 



Thus Lemma 

and \\Q(t, x) x\\ both grow at least exponentially fast as t increases. 

Next, for x € T(x), we have the following growth estimate of \\Q(t, x) x\\ 

Lemma 2.6. For any ieT and any x € T(x), 

\\Q(t,x)x\\ < 2\\x\\eti^ D " g W s ^ +e ^ s ^ ds for all t > 0. 



Proof. Take an arbitrary x £T and then an arbitrary x 6 T(x). Recall (2.101 and 
( |2.11| for C(0). By the definition of T(x) (see ( |2.12[ )), we have that 

(2.17) ||lI(Q(t,x)x)|| < ||n x (Q(f,x)sc)|| and 

(2.18) ||Q(i,x)x|| <2||ll i (<9(t,x)aj)|| 

for all < > 0. Then it follows from ( |2.15b| ) and ( |2.17[ ) that for all t > 0, 

f t \\ll x (Q(t,x)x)\\ 2 <2(j\D a g($(t,x))\\ + £($(i,x)))||n i (Q(i,x) x)f. 
Thus, for all t > 0, 

\\U ± (Q(t,x)x)\\ < \\U ± (x)\\efo(\\ D ^(^m+m(s,x)))ds ^ 



□ 



Then using (2.181, we obtain that for all t > 0, 

||Q(t,x)x|| <2||n i (x)|| e ^(ii D ^(*( s ^)ii+^ s ^» ds 

< 2||x|| e fo(\\ D ^9(^(s,x))\\+£(<S>(s,x)))ds _ 

We are now ready to demonstrate that T(x) is a linear subspace of X. 

Lemma 2.7. For each i£T, T{x) is a linear subspace of X . 

Proof. Take an arbitrary Consider any x%, X2 G T"(x) and any Ai, A 2 G M. 

We prove that x 3 = A1X1 + A 2 x 2 S T(x) by contradiction. 

Suppose x 3 T(x). Then there exists a to > such that (5(t , x) x 3 € int(C(0)). 
Applying Lemma [2.5| to x' :— $(to,x) G T and x' := Q(ta,x) X3, we obtain that 
for all r > 0, 

||n(Q(r, x') x') || > ||n(x')|| e JS'(°(*(».*'))-IP./(*(-^ , ))ll) * , 



which, by (2.9 1, can be rewritten in terms of x and x 3 as follows: 

||II(Q(t + t , x) x 3 ) || > ||n(Q(t , x) x 3 )|| e SS(^Hs+t ,x))-\\D^(<i.(s+t ^)\\)ds 
Let t = r + <o- Then the above estimate becomes 

(2.19) ||n(Q(t,x)x 3 )|| > ||n(Q(i ,x)x 3 )||e / 4( Q (*^»-il^ / W s ^»ll) ds 
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for all t > t . Note tha t ||n (Q(t , x) x 3 )\\ > since Q(t ,x)x 3 G int(C(0)). Thus, 
the right-hand side of (2.191 increases at least exponentially (as opposed to being 
constant 0) for t > to- 



On the other hand, it follows from Lemma [276] that for all t > to, 

||Q(t,aj)a? 3 || < |A 1 |||Q(t,a;)xi|| + |Aa|||Q(t,a;)aj3|| 

< 2(|Ai|||xi|| + |A 2 |||x 2 ||) e /o*(l|£»-fl(*C-.*))ll+*(*(-^))) «to 

< ,, jL(\\Dag(<i>(s,x))\\+£(<S>(s,x))) ds 
— h 1 e ) 



where /i in the last inequality is a sufficiently large constant. By (2.161, this estimate 
contradicts (2.19 1. □ 

Let T(z) denote the cross-section of X at z along the a-direction, i.e., 

l(z) := {(a, z) : a G R n } . 



A consequence of Lemma 2.7 is that T{x) f]J(z) contains at most one point. 

Lemma 2.8. For any x G T, T(x) f]2(z) contains at most one point for each 
z G R m . 

Proof. Take an arbitrary x G T. Suppose there exist Xi ^ cc 2 such that xx, x 2 G 



T(x)f]l(z) for some z G R m . Then x 3 = x 2 - x x ^ 0, and, by Lemma |2J 
x 3 G T(x). On the other hand, 

\\u ± (x 3 )\\ = ||n J .(x 2 )-n J .(xi)|| - ||z-z|| = o. 

Since x 3 ^ 0, we have ||n(£c 3 )|| > ||n ± (x 3 )|| = 0. Then x 3 G int(C(0)). This 
constitutes a contradiction. □ 

In fact, T(x) f s \T(z) contains exactly one point for every z G K m . 

Lemma 2.9. For any x G T, T{x) f]J(z) contains exactly one point for each 
z G R m . 



Proof. Take an arbitrary x G T. By Lemma |2.8| we only need to prove that 
T(x) f]T(z) 7^ for any z G K m . We will use the Wazewski theorem (see Appendix 
|A| , which requires us to work with a flow. Thus, we append f — 1 to (2.8 1 with 
the argument t in $(t,x) replaced by r to form an autonomous system 

f =1, 

x = DF($(t,x))x, 

where (t, x) G (— 6^,00) x X with e x > being a constant that depends on the 
chosen x G T. Let ^ x (t, (t, o;)) be the flow generated by the above system: 

$ x (t, (t, x)) = (t + r, Q(t, $(t, x)) x) . 

We define a set W C (—£^,00) x A as follows: 

W := {(r,x) : r > 0, cc ^ int(C(0))} 

(2.20) = {(r,a;) : r > 0, C(x,0) < 0} . 

Since W is a closed subset of (— e x , 00) x X, it automatically satisfies the condition 
(Wl) in the definition of a Wazewski set (see Appendix lAj , i.e., if (r, x) G W and 



AN INVARIANT MANIFOLD THEORY FOR ODES AND ITS APPLICATIONS 



15 



^ x ([0,t},(T,x)) C cl(W) then # a ([0, t], (r, x)) C W. Next, we define the sets W° 
and W _ as follows: 

W°:={(r,a;)eW:3(>0 such that * a (t, (r,x)) g W} , 

W~ := {(r,x) G W : * x ([0, i), (r, x)) £ W for all i > 0} . 

Note that W° is the set of points that do not stay in W forever under the flow fy x 
in forward time, and W~ is the set of points that immediately leave W in forward 
time. Clearly, W~ C >V C W. In order to verify that W is a Wazewski set, we 
need to check the condition (W2), that is, W~ is closed relative to W°. 

It is obvious that W" C <9W, which is the boundary of W and is the union of two 
disjoint sets S x := {(r,x) : t > 0, £(x,0) = 0} and S 2 := {(0,x ) : £( x,0) < 0}. 
For any (r, x) e Si with x ^ 0, by the fact that $(r, s) e T C !7, ( |2.15 | holds, and 
it leads to 

f t C(Q(tMr,x))x,0)] >0. 

Thus, (r,x) S W~ if (r,x) S Si and x ^ 0. For each (0,x) £ by the 
continuity of C, there exists a to > such that £(Q(t, $(0, 2)) x, 0) < for all 
f € [0,to]- It follows that * x (i, (0,x)) = (*, $(0,a;)) x) € W for all t e [0,t ]- 
Thus, W~f]S 2 = 0- Furthermore, note that for any (r,0) € Si, # x (t, (t,0)) = 
(i + r, 0) e Si C W for all i > 0. Altogether, we have simultaneously 

(2.21) W n{(r,0) :r>0} =0, 

(2.22) W~ =Si\ {(t,0) : t > 0} = {(r,x) : r > 0, x ^ 0, £(x,0) = 0} . 
In addition, by ( |2.21| and ( |2.22[ ), we have 

W°\ W~ C {(t,x) : t > 0, £(x,0) < 0} . 

Thus, for every (r, x) € W° \ W _ , there is a neighborhood V, which contains (r, x) 
and is open in R x I, such that Vp|W~ = 0. Then, W° \ W~ is open relative 
to W°, and W~ is closed relative to W°. Therefore, W is a Wazewski set. By the 
Wazewski theorem, there exists a continuous function 1Z : W° x [0,1] — > W° such 
that TZ is a strong deformation retraction of W° onto W~ . 

We now prove that T(x)f)l(z) ^ for any z € R m . Since e T(x), we only 
need to show that T(x) f)l(z) ^ for any z e M m with ||z|| > 0. We prove this 
by contradiction. 

Assume that T(x)f]l(z) = fo r som e z € R m w ith ||z|| > 0. Let R := ||z||. 
Then by the definition of T{x) (see \2.12\ ) and ( |2.20[ ), we have 

{(0, (a, *)) : ||a|| < R) = {(0, x) : x e T{z)} f] W C W° . 

Thus the set {(0, (a, z)) : ||a| < i?} is contained inside the domain of the continu- 
ous function K( ■ , 1) : W° -> W~. 

Moreover, for all (r,x) G W~, ||II(x)|| = ||n x (x)|| > according to ( |2.22| . Thus 
we can define a projection P : W~ -^{a£ 1" : ||a|| = R} as follows: 

By taking the composition of V, 1Z( ■ , 1), and the map a 1— * (0, (a, z)), we obtain a 
continuous map ?:{a£ K." : ||a|| < R} — > {a € R n : ||a|| = i?} as follows: 

0(a) :=PoK((0,( fl ,i)),l). 
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Since 1Z is a strong deformation retraction of W° onto W , 1Z((t,x), 1) = (r, x) 
for all (r , sc) S W~. Note that for all a with ||a|| = R, (0, (a,*)) S W~ according 



to ( |2.22| . Thus, for all a with ||a|| = R, 

g(a)=VoK((0,(a,z)),l) 
= V(0,(a,z)) 



a . 



The existence of such a Q contradicts the fact that there is no retraction that maps 
a closed n-ball onto its boundary (i.e., an (n— l)-sphere). □ 



Based on Lemma [277] and Lemma [279] we can associate each xeT with a unique 
linear operator H(x) : K m — » M" such that T(ir) is the graph of H(x), i.e., 

(2.23) TM = {(ff(i)2,z):zeR m }. 

In addition, it follows from ( 2.22| that for each fixed iGf, 



C((H{x)z,z),0) < for all z e M m with ||z|| = 1 . 
Then the compactness of the set {z £ R m : ||z|| = l} implies that for any xeT, 
(2.24) ||#(x)|| = max ||i?(a;)z|| < 1. 



z =1 



2.2.2. The map x i— ► i?(x) «s continuous. We first prove the following lemma. 

Lemma 2.10. For any fixed z £ ]R m , the map from T into M. n : x i— > H(x) z is 
continuous. 

Proof. Take an arbitrary x € T and any z 6 M m . We prove that lim^^ ff(ic) 2 = 
i?(i) z by contradiction. Suppose that there exists a constant e > and a sequence 
{xi, X2, X3, ...} C r such that — > x and at the same time 

(2.25) \\H(xi) z - H(x) z\\ > e 

for all i = 1,2,3,.... Since \\H (xi) z\\ < \\z\\ for i = 1,2,3,..., we can take a 
convergent subsequence \H{xi^) z, H(xi 2 ) z, H(xi 3 ) z, ...} and denote its limit by 



a, i.e., H(xi k ) z — * d. Then (2.251 implies that ||d — H(x)z\\ > e. Thus x 
(d, z) ^ r(x), and there exists a fo > such that Q(to,x)x € int(C(0)). Let q be 
the radius of a closed ball that is centered at Q(to, x) x and contained in int(C(0)). 

Let Xi k :— (H(xi k ) z, z) 6 T(xi k ) for fc = 1,2,3,.... Consider the convergent 
sequence {(xi 1 , a^ij, (xi 2 , Xi 2 ), (xi 3 , Xi 3 ), ...} C T x X with limit (a;, a;). Since 
<5(to,^)a3 depends on (x,x) continuously for all (x,x) 6 V x X, we can choose 
an if large enough such that 

||Q(i , x lk „ ) x ik , - Q(t , x) x\\ <q. 

Then Q(t , Xi k , ) x ik , € int(C(0)). However, this is impossible since a; ifc » € T(xj fc .) 
by our construction. □ 



Since -ff(x) is a linear operator from R m to K n for each x € T, Lemma 2.10 
implies the continuity of the map x <— > H(x) for all igT. 
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2.2.3. H(h(z),z) is the derivative of h at z. The final step of establishing the C 1 
smoothness of h is to prove the next lemma. 



Lemma 2.11. h : K — > 

H(h(z),z) for all z e K. 



is differentiable at all z 6 K. In addition, Dh(z) = 



Proof. We will show that H(x) satisfies the definition of the derivative of h, i.e., 
for any z € K and correspondingly x = (h(z), z) G T, 

lim ] ^\\h(z + z)-h(z)-H(x)z\\=0. 

||;z||— >0 << z << 

We prove this by contradiction. Assume that for some z € K and correspondingly 
x = (h(z), z) € r, there exist {zi, 22, £3, • ■•}, a sequence of non-zero vectors in K m 
with ||zi|| — ► 0, and a constant e > such that £ + Zj £ K and 



(2.26) 



+ z^ - h{z) - H(x) Zi\\ > e 



for all i = 1,2,3,.... Let = (h(z + zi) — h(z))/\\zi\\ for i = 1,2,3,.... By 
Lemma [2.3| we have ||a,|| < 1 for any i. Let cc, = (ai,Zj/||Zi||) for i — 1,2,3,.... 
Then {xi, X2, x$, ...} is a bounded sequence in X. Take a convergent subsequence 
{xj 15 X{ 2 , X{ 3 , ...}, and denote its limit by s = (d, z). Note that ai k — > d and 
*i fc /lkijl Then ( |2-26| implies that ||o - #(£)z|| > £• Thus i £ T(x), and 

there exists a to > such that Q(to,x)a: € int(C(0)). Let 5 be the radius of a 
closed ball that is centered at Q(to,x) x and contained in int(C(0)). 

Furthermore, by the constructions of and x t , we have that for any i^, 

x+\\z ik \\x ik = (h(z) + \\z lk \\a lk , z + z lk ) 
= (h{z + Xi h ), z + z lk ) e r. 
Then Q(to, x) € T and ^(io! & + ll^ij, H 35 **) G T according to the positive invariancc 



of r. Note that ||zi fe ||a3i fe ^= for any if.. Thus Q(to,x 



\x lk ) £ C(<t>(t ,x)) 



(see the proof of Lemma 2.3 1 for any i^. 

On the other hand, note that Q(to,x) is just the derivative of <fr(to y x) with 
respect to x evaluated at x — x. Recall that by our construction, {xi ± , Xi 2 , Xi 3 , ...} 
is bounded and \\z t 



(2.27) 



2 > 

3 — 



'ik 
1 



0. Then there exists an N such that for any if. > N, 
|*(fo,a+ \\z lk \\x lk ) - $(t ,x) - Q(t ,x)(\\z ik \\x ik )\ 



,\\x ik ) - ®(t ,x)) - Q(t ,x): 



In addition, we can choose an ik* > N such that 

(2.28) \\Q(t ,x)x lk , -Q{t ,x)x\\ < f . 

Combining ( |2.27| and ( |2.28| ), we obtain 

5 -J- 1 -($(f ,x+ ||z ifc . ||x ifc .) -$(i ,£)) -Q(*o,i): 



<1 



which implies that 



($(*o, 



.||aj <fc .)-*(to,x)) €int(C(0)) 



It follows that <i>(to, 2; 
diction. 



2 ifc » ||a;$ fc » ) € int (C($(t , £)))■ This constitutes a contra- 



□ 
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Note that the map from K onto T: z i— > (h(z),z) is continuous. Thus Dh{z) = 



H(h(z), z) is continuous with respect to z on K. Finally, it follows from (2.24) that 



||D/i(z)|| < 1 for all z G K. This concludes the proof of the C 1 smoothness of h. 

3. Proof of Theorem 11.21 



We begin with the assumption that the positively invariant set V is a C 1 manifold 
embedded in M. n x K m as the graph of the C 1 function h from an open, convex K C 
E m to M™. The proof of the C r smoothness of ho proceeds as follows. In Subsection 



3.1 we derive a system that describes the dynamics of D ho along trajectories in the 



C 1 mani fold V. In Subsection 3.2 we show tha t this system can also be put into the 
form of (1.3 1. Then by applying Theorem |l.l| we prove that the set {(Dh (z), z) : 
z G Ko} can be smoothly embedded into an appropriate Euclidean space as a C 1 
manifold, which implies the C 2 smoothness of ho- Finally, in Subsection |3.3| we 
demonstrate how to apply this argument inductively to establish the C r smoothness 
of ho- 

3.1. The Dynamics of Dh along Trajectories in T. We shall continue to use 
some of the notations that have been introduced in Subsection |2.2| However, from 
now on we represent all linear operators as matrices. In particular, for each ieT, 
the (n + m) x (n + m) matrix function 1 1— > Q(t, x) is just the fundamental matrix 



solution of (2.8) with parameter x, satisfying the matrix differential equation 

Q(t,x) = DF{<$>{t,x))Q{t,x) 
with Q(0, x) = I n +m, which is the (n + m) x (n + m) identity matrix. 



Restricting the z-component of (1.3 1 to T, we obtain 

z = g(h (z),z) , 

which generates a flow <fi(t, z) on K - Due to the positive invariance of V, <f>(t, z) is 
related to <i>(i, x) in the following obvious way: 

(ho((/>(t, z)),(p(t, z)) — <i>(i, (ho(z), z)) for any z E K Q and any t > 0. 

Then the dynamics of Dho along trajectories in T are governed by a matrix Riccati 
differential equation as stated in the next lemma. 



Lemma 3.1. Consider any system in the form of (1.3) with f and g at least C . 
If ho : Ko C W n — > R n is C 1 and T — {(ho(z), z) : z S Ko} is positively invariant, 
then for each fixed z G Ko, the matrix function Dho(<f>( ■ , z)) : [0, oo) — > j^nxm 
(the space of n x m real matrices) is a solution of the following matrix Riccati 
differential equation: 

(3.1) V 1 = D a f V 1 - V'Dzg - V'Dag V 1 + DJ , 

where V 1 G M. nxm and D a f, D z f, D a g, and D z g are all evaluated along the 
trajectory (ho((f>(t,z)),(f)(t,z)) for t > 0. 

Proof. Take an arbitrary z G Ko and correspondingly x = (ho{z),z) G T. First, 
we show that the matrix function Dho(4>( ■ , z)) : [0, oo) — > K" xm is continuously 
diffcrcntiable. 

Note that for any t > 0, Q(t, x) maps the tangent space of V at x to the tangent 
space of r at <j>(i,x). It follows that for any z G K m , 

(3.2) Q(t, x) (^W) , = W*' Z ») (0 mxn J ro ) Q(t, ,) z . 
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Note that for any z 6 W n with ||z|| > 0, the left hand side of (3.2 1 represents a 



solution (of (2.8) with the parameter x = (h (z),z) € T) that cannot reach the 



origin for any finite t > 0. Thus it must be true that for any t > 0, the null space 
of the product of the second, third, and forth matrices on the right-hand side of 
(3.2 1 is the trivial subspace of M. m . Therefore, this product produces an invertible 



matrix for any t > 0. Solving (3.2 1 for Dho(4>(t, z)), we obtain 

(Omxn 



Q(t,x) 



Dh (z) 



Dh (ct>(t,z)) = {I n nxm )Q(t,x) ( Dh °W 

In view of the differentiability of Q(t,x) with respect to t, Dho(4>{t, z)) is continu- 
ously differentiable with respect to t for all t > 0. 

Next, we de rive a differential equation for Dho(<fi(t, z)). Choose any t > 0, and 
consider (2.141 at {Dh {4>{t, z)) z, z) E T^u^sT for an arbitrary z E R m . Then we 
have 



(f t Dho(<t>{t,z))) 



Dh {<f){t,z))z 

= £)«/($(*, x)) Dh (4>(t, z)) z + D z f($(t, x)) z , 
z = D a g{<$>{t, x)) Dho(<f>(t, z)) z + D z g{$>{t, x)) z . 



Combining these two equations and reorganizing terms, we obtain that Dho(<fi(t, z)) 
satisfies the matrix Riccati differential equation (3.1l with the coefficient matrices 



Daf , Dzf, D a g, and D z g all evaluated along the trajectory <6(i, x) — {ha(<j)(t, z)), 
4>(t, z)) for t > 0. □ 



3.2. The C 2 Smoothness of Hq. For each z 6 Kq, (3.1) defines a time varying 
system in R nxm along the trajectory (ho((f)(t, z)), (f)(t, z)) for t > 0. Thus, we can 
couple (3.1 1 with the underlying equation z — g(h Q (z), z), which generates the flow 

r xm x Rq ag foUows . 



(j)(t, z), to form a system in 
(3.3a) 

V 1 - D a f(h (z),z) V 1 - V'D.gihoiz), z) - V 1 D a g(h„(z), z) V 1 + DJ{h (z), z) , 
(3.3b) 
z = g(ho(z),z) , 

where V 1 eR nxm and z € K Q . 

In the subsequent analysis, it is more convenient to consider the "vectorization" 



of the matrix differential equation (3.3a). Recall that the vectorization of a matrix 



is a transformation that converts the matrix into a column vector by stacking the 
columns of the matrix. Let vec nm : W ixm — ► M. nm be the vectorization of n x m 
matrices, and let vec~^ : W lm — > R" xm be the inverse of vec„_ m . Notice that for 
any A E R nxn , B E E" lXm , and P E R nxm , 

vec„ m (APB) = (B T O A) vec„, m (F) , 



where "(g)" denotes the Kronecker (or tensor) product of two matrices. Then (3.3a) 
can be converted into 

v 1 = (Jm® D a f(ho(z),z) ~ (D z g(h (z),z)) T <g> jj 

- (j TO ® (vec- 1 > 1 )D a .g(/i (^),2))) w 1 + vec nim (DJ(h {z), z)) , 
where v 1 := vec^V 1 ) E R nm . 
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Furthermore, we rescale z to Q 1 := a 1 1 z with the scaling factor <j\ > t o be 
determined later. Let K x := {C 1 € E m : ctiC 1 £ K }. Then we transform (|3.3|) into 
a system defined on E" m x Ki as follows: 

(3.4) *-A(*.C>. 

e = 71(C), 

where w 1 € R" m , (' € if b and the functions 71 : #1 -> E m and /1 : E" m xXi-t 
E" m are defined as follows: 

(3-5) 7i(C 1 ):=£$(MffiC 1 WC 1 ), 

C 1 ) := (/«, ® A./fafaO.ffiC 1 ) ~ (-D*<7(/io(^C I ),<7iC 1 )) T ® in) «* 

+ vec n _ m (D z f(h (a 1 C),a 1 C))- 

Choose Ji, a bounded, open subset of E™ m , as follows: 

Ji := {w 1 S E™" 1 : || vec-^w 1 )!! < v} , 

where, as postulated in Hypothesis [4] r\ is a positive constant such that ||Z)/io(^)|| < 
r\ for all z £ i^o- Obviously J\ x ifi satisfies Hypothesis [T| In what follows, we will 
verify that the restriction of ( |3.4| to J\ x K\ satisfies Hypothesis [2j 

Lemma 3.2. fx is C 1 on J± x K\, and is C 1 on K\. Furthermore, there exists 
a constant L\ > independent of the choice of o\ such that \\Dfifi(y 1 , < fi^i 
for any (v 1 ,^ 1 ) G Ji x K\ . 

Proof. By Hypothesis [5] / and g are C r (r > 2) with their first to r-th derivatives 
all bounded on Uq. In addition, /i is C 1 with ||D/i ( z )ll < ?7 f° r a U z G i^o- Then 
by inspecting (3.5) and (13. 61), we obtain the abovementioned properties of f\ and 



71. □ 

Define a continuous function a\ : K± — > E as follows: 
(3.7) ^(C 1 ) := a^o^iC 1 ), ctiC 1 ) - ^M^iO^iC 1 ) " 27 1 \\D a g(h (<7 1 C),o- 1 C)\\ . 
By ( 1.7c] ) of Hypothesis |5] we have that ai(C 1 ) > for all (' e Ki. 
Lemma 3.3. For any (vq,Q) £ -it x K\ an d an V v± £ E nm , 
(3-8) («SiV/i(<Co>0>«i(Co)ll»T ■ 



Proof. Take an arbitrary (vq,Q) G <ii x i^i- It follows from (3.6) that 

A,i/lK, Co) = im <8 D a f(ho(o-ie o ), <Tl<o) ~ (£»z5(/lo((7lCo)^lCo)) T ® *n 

- J m <g> (vec^(^)D a g(/i (<TiCo),criCo)) 



(Dagihoia^o), CTlCo) ve c;i("o)) T ® 4 



Taking account of ( |1.7a l, it is straightforward to verify that for all w 1 e E nm , 

(t^(J TO ®i?,/)« 1 >>a|h> 1 || 2 > 

where both D a f and a are evaluated at (/io(ciCo), °iCo)- 

Next, take any w 1 € E™ m and correspondingly = vec";^ 1 ). We have that 

(v\((D z g) T ®I n )v l ) - (vec B , m (V 1 ),vec B , m (V 1 D,ff)) 
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= <vec m ,„(y lJ ),vec m ,„((^g) T y lJ )) 

= ( vec m ,„(V lT ), (/„ ® (D z gf) vec m ,„(t/ lT )) 

= (vec m ,„(V lT ),(/„ ® ( J D z5 ) T ) T vec m ,„(y lT )) 

= < vec m ,„(y lT ), (/„ ® vec m ,„(F lT )) 

<£||vec m , n (F lT )|| 2 = l\\v 1 \\ 2 , 

where both D z g and i are evaluated at (^o( (J iCo); ^lCo) throughout and the in- 
equality follows from ( 1.7b I. 

Similarly, we obtain that for any v 1 £ R nm , 

(v 1 ,(l m ®(vec-l(v 1 o)D a g))v 1 )\ " ll vec ^( w o)^llll» 1 f<»/IP«flllll« 1 ll 2 . 

(v\ ((D a g vec^)) T <g> /„) v 1 )) < ||£> Q <7 vec^vj) || Hu 1 || a < ^HA^HIHI 2 , 

where -D a g is evaluated at (/io(ciCo)j °iCo) throughout and || vec~^(uo)|| < f\ by our 
choice of J x . 



Combining all the estimates above, we attain the inequality (3.8). 
Define a nonnegative, continuous function l\ : K\ — > M. as follows: 
(3.9) MC 1 ) := »7||l? off (/io(criC 1 ),^iC 1 ) II +^(^0,^1^) • 



□ 



Then in view of (3.51, the next lemma is a trivial consequence of (1.7b I. 
Lemma 3.4. For any Q £ K\ and any C 1 £ M. m , 

(3.10) (c\D7i(Qe)<h(ti)\\e\\ 2 - 

In addition, we have the estimate described in the following lemma. 
Lemma 3.5. There exists a sufficiently small o~i such that for any £ Ki, 

(3.11) ai (C) > t l {C)+oxLx + \c r . 

Proof. It follows from (1.7c I of Hypothesis [5] that for any z £ Kq, 

(3.12) a(h (z),z) > 2£(h (z),z) + 3r)\\D a g(h (z),z)\\+c r . 



In addition, since L\ > is independent of the choice of <j\ (see Lemma 3.2), we 
can choose o\ sufficiently small so that o~\L\ < \c r . Then by combining this with 
(3.121, we obtain the inequality (3.11) after replacing z with o\Q and rearranging 
terms according to (3.7 1 and (3.9). □ 



Note that the (^-component of (3.4 1 is independent of v 1 . Thus Lemmas 3.2 3.5 
verify that the restriction of (3.4 1 to J x x K\ satisfies Hypotheses [2j 

Recall that ||Z?/i (z)|| < r\ for all z £ K . Define hi : Ki — > Ji as follows: 

(3.13) ^(C 1 ) := vec„, m ( J D/ l0 (aiC 1 )) • 

Now consider the set 

T x ^{(MC'U^C'^iJc JixKl 

Clearly, Ti is positively invariant under the flow of ( |3.4[ ). Then, by applying The- 
orem [Ll] we obtain the following result. 

Lemma 3.6. Ti is a C l manifold. In particular, hi : K\ — ► Jj is C 1 with 
\\Dhi(C)\\ < 1 for all C e Ki. 
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Note that Dho(z) = vec^^/iifV^z)) for any z € Kq. Therefore, we have 
proven that ho : Ko — ► K™ is C 2 with its first and second derivatives bounded on 
Kq- Furthermore, 

D 2 h (z)( Zl , z 2 ) = a- 1 vec-HDh^a- 1 z) z x ) z 2 
for any z £ K and any Z\, z 2 S K m . 

3.3. The C r Smoothness of Hq. In this subsection, we apply the argument used 
in the previous subsection inductively to establish the C r smoothness of ho for the 
case with r > 3. 

We illustrate how the argument works again in the proof of the C 3 smoothness of 
ho. First, let <fii(t, C 1 ) be the flow on K\ generated by C 1 = 71(C)- Then by Lemma 
|3.1| we have that for each fixed Q £ K\, the matrix function • , C 1 )) : 

[0, oo) — > M. nmxm is a solution of the matrix Riccati differential equation: 

(3.14) V 2 = D v ifi V 2 — V 2 D r ) 1 + D^ifi , 

where V 2 £ E nmxm and D v ifi, -D^i/i, and D-fi arc all evaluated along the trajec- 
tory (hi(4>\(t, C 1 )), </>i(i, C 1 )) for t > 0. Compared to (3.11, the right-hand side of 
does not include the term quadratic in V 2 since U v vyi — 0. Next, we couple 
with the underlying equation Q — 7i(C 1 ) to form a system in K™ mxm x K\ 



3.14 



3.14 



as follows: 

(3.15a) V 2 = DMh x {C),C) V 2 - V 2 D ll (C) + D^f^C), C) , 

(3.15b) C=li(C)- 

We shall again consider the vectorization of the matrix differential equation 
(3. 15a I. Let vec„ mm : K™ mxm _ > R ram be the vectorization ofreraxra matrices, and 
let vec~^ m be the inverse of vec„ mm . Furthermore, we rescale C 1 to C, 2 :— o 2 X Q with 
the scaling factor a 2 > to be determined. Take if 2 := {( 2 £ K m : cr 2 C 2 € K{\. 
Then we transform (3.151 into a system defined on R nm x K 2 as follows: 

(3.16) 

C 2 =72(C 2 ), 

where := vec nm , m (F 3 ) € M"™ 2 , C, 2 £ K 2 , and the functions ~/ 2 : K 2 ^ R m and 
/ 2 : M'"" 2 x JT 2 -> M"™ 2 are defined as follows: 

(3.17) 72 ( C 2 ):= i 7l ( CT2 C 2 ), 

(3 18) f ^ v ''^ := ( / ™®^ 1 /i( /l i( ff 2C 2 )^2C 2 )-(^7i(^C 2 )) T ®^ m )« 2 
'""'^ +vcc„ m , m (C cl / 1 (/ ll (a 2 C 2 ),a 2 C 2 )) • 

2 

Choose J 2 , a bounded, open subset of M. nm , as follows: 

J 2 := {i; 2 £ R nm ' 2 : || vec^> 2 )|| < 1} . 

Obviously J 2 x K 2 satisfies Hypothesis [TJ In addition, the restriction of (3.161 to 
J 2 x K 2 again satisfies Hypothesis [2] as verified below. 

Lemma 3.7. f 2 is C 1 on J 2 x K 2 , and 7 2 is C 2 on K 2 . Furthermore, there exists 
a constant L 2 > independent of the choice of a 2 such that \\D^2f 2 (v 2 , £ 2 )| < <r 2 L 2 
for any (v 2 ,( 2 ) K 2 . 
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Proof. So far, we have prove n that 1) ho is C 2 with Dho and D 2 Hq both bounded 
on K and 2) hi defined by (3.131 is C 1 with Dhi bounded on K\. Thus, by our 
assumption that / and g are C r (r > 3 in this c ase) with their first to r-th derivatives 
all bounded on Uq, now f-y and 71 defined by (3.6 1 and (3.5 1 are both C 2 with their 
first and second derivatives bounded on J\ x K\ and Ki, respectively. In turn, f 2 
is C 1 with || ^2/2 1| < (72^2 on J2 x K 2 for some L2 > 0, which is independent of 
the choice of 02 . In addition, 72 is C 2 since it has the same smoothness as 71. □ 



Define continuous functions a 2 '■ K 2 — * K and £2 '■ K2 

(3.19) a 2 (C) := a 1 (a 2 C) ~ h((T 2 C) , 

(3.20) hiC) := h(<J20 ■ 



as follows: 



Clearly, a 2 is positive because of (3.11), and l 2 is nonnegative as l\ is. In addition, 
we have a set of estimates for U2 and £2 similar to what we have for a\ and l\ in 
Lemmas I3.3H3.51 



Lemma 3.8. For any (wq,Co) ^ -h x K 2 and any v 2 e R nm , 
(3.21) (v\D v2 f 2 (v 2 ,Q)v 2 ) > MQWW 2 ■ 

Proof. Consider an arbitrary (vq,Q) G J2 x fs^. Notice that D v 2f 2 is simply the 
coefficient matrix left-multiplied to v 2 in (3.181. By the same arguments as what 
we ha ve used in the proof of Lemma 3.3 and incorporating the estimates (3.8 1 and 
(3.101, we have that for all v 2 

.2112 



(v 2 ,((D7i) 



" T ^Inm)v 2 ) <^l|| V 2 || 2 , 

where D v if± is evaluated at {hi(a 2 Q) , ct 2 £q) ano - ^7ii a ii an d ^1 ar e all evaluated 
at <T 2 Co- Then (|3.21| follows. 



□ 



Lemma 3.9. For any Q £ K 2 and any £ 2 £ M. m , 
(3-22) <C^7 2 (CSK 2 >< WIICT- 

Lemma 3.10. There exists a sufficiently small 02 such that for any £ 2 G i*sT 2 ; 
(3.23) a 2 (C 2 ) >^ 2 (C 2 )+ ^£2 + §<V. 



Proof. Since (1.7c I holds for some r > 3, we have that for any z 6 Kq, 

(3.24) a(/ioW,2) > 3^(/io(2),z) + 47 7 ||D a5 (/i (z),z)|| + c r . 

In addition, since L2 > is independent of the choice of a 2 (see Lemma 3.7 ), w e 
can choose 02 sufficiently small so that a 2 L 2 < \ c r- Combine this with (3.241. 
Recall (3.7 1, (3.9 1, (3.191, and (3.201, and rearrange terms accordingly. Then we 
obtain (3.231 once replacing z with cio^C 2 - ^ 



Again, since the (^-component of (3.161 is independent of v 2 , Lemmas 3.7 3.10 
verify that the restriction of (3.161 to J 2 x K2 satisfies Hypotheses [2] 

Recall that ||L'/ii(C 1 )ll < 1 for all C 1 € K x (see Lemma |3~(3]). Define h 2 : K 2 -> J 2 
as follows: 



(3.25) 

Now consider the set 



h 2 (C 2 ) ■■=yec n „UDh 1 {a 2 C)) 



T 2 ■■= {(h 2 (( 2 )X 2 ) ■■ C £ K 2 } C J 2 x K 2 . 
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Clearly, r 2 is positively invariant under the flow of (3.161. Then, by applying 
Theorem 1 1 . 1 1 again , we obtain the C 1 smoothness of h 2 . 

Lemma 3.11. T 2 is a C 1 manifold. In particular, h 2 : K.% — > J 2 is C 1 with 
\\Dh 2 (C)\\ < 1 for all C &K 2 . 

Since Dh^Q) — vec^ (/^(ctJ f 1 )) for any e Ki, we have proven that hi : 
Ki — > Ji is C 2 with its first and second derivatives bounded on K\ . Therefore, ho ■ 
Kq — > R™ is now C 3 with its first to third derivatives bounded on Kq. Furthermore, 

D 3 h (z)(z l7 z 2 ,z 3 ) = (T^ 1 ^ 2 vec~l(vec~^ m (Dh 2 (o- 2 ' 1 o-^ 1 z) z x ) z 2 ) z 3 

for any z £ K and any z 1; z 2 , and z 3 € R m . 

3.3.1. Induction. Up to this point, the inductive scheme of the proof has become 
obvious. Consider r > 4. Suppose that we have proven the C k smoothness of ho 
for some 3 < k < r — 1 and are about to prove the C k+1 smoothness of h . Then 
we have already established the following prerequisites. 

(1) For j = 2, k, we have defined C 3 , Kj, and hj : Kj — > R n ™ 3 recursively as 
follows: 

A', := {C J e R m : e iVi} . 

(3.26) /ij(C 3 ) := vec^-i^D^-i^C')), 

with each <jj chosen sufficiently small. In addition, we have already proven 
that for each j = 1, k- 1, hj is C fc " J ' with ||D%(C0II < 1 for all C J € iiTj 
and all applicable higher derivatives bounded on Kj. 

(2) For j = 2, fc, we have defined 7j : ^ -> R m and : R"" 1 ' x -> R"" 1 ' 
recursively as follows: 

fj{v\ C 3 ') := (J m A^i-iCVi^C 3 '),^) - (2>y 3 --i(o- i C i )) T ® 4mi-0 « J ' 
+ vec w -i m (D CJ -ifj-i (hj-i (o-jC' ) , a-j ( J )) , 

where u 3 ' e R" m ' and C J S 

(3) For j = 2,...,fc, we have defined continuous functions aj : ifj — > R and 
£j : Kj — ► R recursively as follows: 

4(C'):=VifoO- 
Then we shall consider the system 

, s v h = fk(v k ,C), 

3.27 

e = 7 fc (c fc ) , 

which is defined on R nm x Kk- Next, choose a bounded, open subset of R™ m , 
as follows: 

J k :={v k eM nm " :||vec-^_ 1>m K)|| < 1} . 

Obviously Jk X satisfies Hypothesis [T| In addition, the restriction of (3.27) 
to Jfe x Kk again satisfies Hypothesis [2] and the verification is now routine. In 
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particular, following the same arguments as used in the proofs of Lemmas |3.7f|3.10| 
it is straightforward to verify the following statements about 7^, a^, and 

(1) fk is C 1 on Jfe x Kk, and 7^ is C k on Kk- Furthermore, there exists a 
constant Lk > independent of the choice of a k such that \\D^kfk(v k , C fc )|| < 
<j k L k for any (v\C fc ) G Jk x iffc. 

(2) For any (ug, Co) G J fe X K k and any G R nm " , 

(«*, u^/kCwS, Co) «*> > "*(Co)ll« fc ll 2 - 

(3) For any C fc G A" fe and any C fc € K m , 

{C,D lk (Co)C)<h(C )\K k f- 

(4) There exists a sufficiently small Ok such that for any ( k G Kk, 
(3.28) a k {C)>l k {C k )+(TkLk + \c r . 

Now we consider the set 



which, by our construction, is positively invariant under the flow of (3.271. By 
Theorem |l.l| Tk is a C 1 manifold. In particular, hk ■ Kk — > J k is C with 
||D/ifc(C) || < 1 for all C fc G -Kfc- Then, in view of the inverse of the recurrence 
relation ( 3.26[ ), we have proven that for each j = hj is C k+1 ^^ with 

\\Dhj(( j )\\ < 1 for all C j G iij and all applicable higher derivatives bounded on 

£ n is now C k+1 with its first to (k + l)-th derivatives 



Kj. Therefore, ho : K t 
bounded on Kn. Furthermore 



10 



D k+l h {z){ Zl ,...,Zk + i) 
-1 



(J, 



<7i k vec~ 



(Dh k ((T 



-1 

k 



<r 1 1 z) zi) z 2 - ■ ■) Zk+1 



for any z £ Kq and any Z\, Zk+i € M m . 

Finally, we remark that the inequality (3.28) is guaranteed by (1.7c I provided 
that k+ 1 < r. Therefore, the induction has to cease at k = r — 1 with the outcome 
of the last iteration being that ho is C k+1 = C r . This concludes the proof of 
Theorem O 



4. Applications 

4.1. Invariant Tori in a 2-Parameter Family of Systems. Consider the fol- 
lowing 2-parameter family of systems: 



(4.1) 



R 



R(8f3 - R) 4 
0R + (3 2 sin ( 



>i sin ( 



where R G M, (/>i S [0, 27r] and 02 G [0,27r] are two angular variables with the end 
points and 2ir identified, and f3 G (0, 00) and to G K are the two parameters. 



We are interested in determining for what parameter values (4.1l has C r (r > 1) 



invariant tori. However, even with the help of numerical methods, it is a challenging 
task to identify the exact set of parameters for the existence of C r invariant tori. 
Here we apply Theorem |1.1| and Theorem |1.3| to derive sufficient conditions on the 
parameters for the existence of C r invariant tori for (4.1). 
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We need to modify (4.1 1 slightly to fit the form of ( 1.3 1. This is done by lifting </>i 
and cf>2 to R. Furthermore, we rescale 4>i to 9\ := k~ l 4>i and 2 to 9 2 := (kj)" 1 ^ 
with the scaling factors k > and 7 > to be determined later. The purpose 
of this rescaling of variables is to obtain a larger set of parameters for which the 
existence of C r invariant tori can be guaranteed by Theorem 1 1 . 1 1 and Theorem 1.3 
Write 9 = (61,82). Then dO becomes 



(4.2) 



R = f(R, 9) := R(8(3 - R) + sin fc0i + sin kj8 2 ■ 



g(R, 



-R 



sin k9\ sin kj9 2 

fe7 , 



where we have treated JigM and 9 € K 2 as "a" and "z" of (1.3), respectively. In 
addition, for any 6 > 0, define the set f/a as follows: 

U s := {(R,8) :\R\<S,8e M 2 } , 

which clearly satisfies Hypothes is [l] 

In order to apply Theorem 1.1 we have to first establish the existence of a 
positively invariant set T that is contained in Us and satisfies 

(4.3) Tl ± (T) =Tl ± (U s ) =R 2 , 

where II ± is the projection onto the 0-coordinate. We define V C Us to be the set 
of points that stay in Us forever along solution trajectories of (4.2 1 in forward time. 
Obviously, T is the largest positively invariant subset of Us by this definition. Next, 
we show that V satisfies (4.3 1 using the Wazewski theorem. 
Note that at the boundary of Us, 

R > S(&(3 - 5) - 2 for any (R, 9) with R=S, 

R < - S(8P + S) + 2 for any (R, 9) with R = -5. 

Thus, for any (3 > and S > satisfying 

(4.4) 5(8(3 - 6) - 2 > , 

R > for any (R, 9) with R = S, and R < for any (R, 9) with R = -5. Then 
it can be easily verified that c\(Us) is a Wazewski set with its boundary dUs being 
the set of points which leave c\(Us) immediately along solution trajectories of (4.2) 
in forward time. Let Ug C cl(Us) be the set of points that do not stay in cl(Us) 
forever in forward time. Then by the Wazewski theorem, there exists a continuous 
function TZ : Ug X [0, 1] — * U$ such that 1Z is a strong deformation retraction of Ug 
onto dUs- Now suppose that for some 9*, 

Tf){(R,9*):\R\<S}=Q). 

\R\ < is contained inside the domain of the continuous 



dUs- Immediately, we obtain a continuous function defined 



Then the set {(R,6*) 
function Tl( ■ , 1) : J7 5 ° - 
on [—(5, 6] as follows: 

R^TloK((R,9*),l) , 

where II is the projection onto the i?-coordinate. However, the above continuous 
function has the impossible property that 

II o 1Z((R, 8*), 1) G {-5,6}, 

TloK((6, 6>*), 1) = 6, 
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uon((-s,e*),i) = -s. 



Thus, Tf]{(R,9) : \R\ < 8} ^ for any 9 G R 2 . This confirms (4.3 1. 

Next, we verify Hypothesis [2] and Hypothesis [2^ for (4.2) on Ug. Straightforward 
calculation shows that for any (R, 9) G Us and any (i?', 9') e I x R 2 , 

(R',D R f(R,9)R) > (8/3 -25)\R' | 2 , 
(O',D e g(R,O)0') </3 2 yTT^||0'|| 2 , 
||I>*/(iZ,0)|| <fcVl + 7 2 , 
||X> flfl (Ji,0)|| = g. 
It follows that for any /3 > 0, S > 0, and fc > satisfying 
(4.5) 8/3 - 25 - /3 2 - fc - § > , 

there exist sufficiently small 7 > and C\ > 0, both depending on /3, <5, and fc, such 
that 

8/3 - 25 > /3Vl + 7 2 + fcv 7 ! + 7 2 + f + ci , 
which implies (1.6c). Therefore, by Theorem |1.1| ( |4.4| and (4.51 together guarantee 
that r is a C 1 positively invariant manifold. Furthermore, if there exists an integer 
r > 2 such that /3, S, and fc also satisfy 



>0. 



(4.6) 8(3-26-r{3 2 -(r+l)t k 

then, taking a sufficiently small c r > and reducing 7 further if necessary, we have 

8/3 - 26 > r(3 2 y/l + 7 2 + (r + 1) § + c r , 

which implies ( |1.6{ i). Consequently, if /3, 8, and fc satisfy (4.4)-(4.6) for some r > 2, 
then r is in fact a C r manifold by Theorem |1. 3 1 

Note that the inequalities ( 4.4 H 4.6 1 involve the auxiliary parameters S and 
fc, which do not appear in the original system (4.1). In order to eliminate these 



auxiliary parameters to obtain conditions on /3 only, we consider the /3-projection 



of the solution set of (4.4 1— (4.6|. Let Qi denote the set of triples (/3, 5, fc) that 
satisfy both (4.4) and (4.51. In addition, for r — 2,3,4,..., let Q r denote the 



set of triples (/3,<5, fc) that satisfy (4.4), (4.51, and (4.6 1 for the corresponding r. 
Elementary computation reveals that Q r = for all r > 8. Furthermore, we find 
that for each r — 1, ...,7, the /3-projection of Q r is a connected interval (/3~,/3+) 
with the approximate values of (3~ and /3+ given in the table below. Note that 
(/3r,/3+) D (/3 2 -,/3+) D ■ ■ o (/3f,/3+). 



r 


1 


2 


3 


4 


5 


6 


7 




0.395 


0.404 


0.420 


0.441 


0.472 


0.518 


0.634 


ft 


7.248 


3.887 


2.542 


1.849 


1.412 


1.093 


0.781 



Table 1. /3~ and /3+. 



Now consider (4.1) with an arbitrary to G R and a /3 drawn from one of the 
intervals (/3~,/3+), r = 1,...,7. Since (/3~,/3+) is the /3-projection of Q r , we can 
always find appropriate <5, fc, and correspondingly a sufficiently small 7 such that 
(if r = 1) or Theorem |1.3| (if 2 < r < 7) is applicable to the modified 



Theorem 



1.1 



system (4.2) with (/3, uj, fc,7) on the domain r/,5. Then we establish the existence 
of the C r positively invariant manifold T, which, however, depends on (3 and u> as 
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well as the choice of the auxiliary parameters k, 7, and S. Specifically, by Theorem 
|l . l| or Theorem |l.3[ T is the graph of a C r function h(-, •; j3, u>, k, 7) : M 2 — > (—5, 6), 
i.e., 

r = {{h{9 1 ,e 2 ]p,u;,k, 7 ),e 1 ,0 2 ) ■. (9 U 9 2 ) e r 2 } c cr,. 

Consequently, for (4.1 ) with ((pi, (j> 2 ) lifted to R 2 , we obtain a C r positively invariant 
manifold 

{(Mlr.feAw ) fc ) 7) ) 0i ) ^) : (0i,0 2 ) eK 2 }. 



(4.7) 



On the other hand, suppose we can choose fc', 7', and 5' such that for (4.2 1 with 
(f3,Lu,k f ,7') there is also a C r positively invariant manifold T', which is the graph 
of a C r function h(-, ■; /3, w, k', 7') : M 2 -> (-<?', <5'), i.e., 

T' - {(h(e'i,6' 2 ;(3,uj, k', i),e'i,6' 2 ) :(e'i,9' 2 )eR 2 } C U S , . 

Then, for (4.1 1 with (<f>i,(j) 2 ) lifted to K 2 , we obtain "another" C r positively invari- 
ant manifold 

{(/^,^;/3,w,fc,7'),0i,0 2 ) : (0i, 2 ) € M 2 } . 
We show that in fact 

(4.8) Mx> ^;0,w,k,-y) = fc(ff, ^-i5,uj,k',i) for all (0i,0 2 ) e M 2 . 

Without loss of generality, we assume S < 5' . It follows that for all (9i, 9 2 ) € R 2 , 

\h(9i,9 2 ;p,co,k n )\ <8'. 

In addition, by the relation (<j)i,4> 2 ) = (k9i, kj9 2 ) = (k'0'i,k' r )'d' 2 ), the positive 
invariance of T under the flow of (4.2) with ((3,u,k,j) implies that 

f := {(h(^,!^A-,p,uj,k,j),9'i,9 2 ) : (9[,9' 2 ) G R 2 } C 17,, 



is positively invariant under the flow of ( |4.2[ ) with (/?, w, A:', 7'). Recall that by defi- 
nition r' is the largest positively invariant subset of Us> for (4.2) with (f3, cu, k' , 7'). 
Thus, fcr', which implies that for all (9[,9 2 ) £ R 2 , 

fe(?,^;A"-^) = h(9[,9' 2 ;(3, u, k', 7') . 



Then we obtain (4.8 1 by substituting 9[ = and 9' 2 — ^7 into the above identity 



Therefore, for each (f3,u) e (j3 r ,/3+) x R, (4.1l with (4>i,4> 2 ) lifted to R 2 has a 



unique C r positively invariant manifold that is contained in U§ for a certain S > 
and that is the graph of a C r function from M 2 to R as given by (4.7). 

We still need to show that (4.7) corresponds to a C r invariant torus. By the 
definition of T, the trajectory that passes through (h(6i, 9 2 ; v, k, 7), 61, 9 2 ) is 
contained in Us forever in forward time. Then by the periodicity of (4.2 1 in 9i 
and 9 2 , the trajectory that passes through (h(6i, 9 2 ; [3, uj, k, 7), 6>i + 9 2 + 2 j^ L ) 
for any integers n and m is also contained in Us forever in forward time. Thus 
(h(9i,9 2 ;(3,uj,k,-f),9i 

(4.9) h(9i,9 2 ;/3,uj,k,-/) 

For (01,02) E R 2 , let p 



2mr 
fe 



2 + which implies that 

h(9i + 2 ^,9 2 + 2 f^;p,u;,k, 1 ) 



,0 2 ;/3,w) := h(f,^;(3,u,k,j), which is well defined 
in view of (4.8 1. Clearly, p"(0i, 02 ; (3, u>) is C r in 0i and 2 , and it is 27r-periodic 
in 0i and 02 by (14. 91). Therefore, (4.7) corresponds to the C r torus 



rpU 
1 0,LO 



{(p tl (0i,0 2 ;/3,w),0i,0 2 ) : 01,02 GM(mod27r)} 
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It is easy to verify that Tg w is invariant under the flow of (4.1 1 (with the correspond- 
ing (3 and lu) in both forward time and backward time. Note that the superscript 



: V reflects the obvious fact that T% , is unstable. 



After establishing T% w , we also consider the time reversal of (4.2 1 on the domain 
{(R,6) : \R — 8/3\ < S, 9 £ R 2 }. By repeating all the analysis presented so far in 
this subsection, we find that for any (/3,w) £ (/3~,/3+) x R with 1 < r < 7, (4.1) 
has another C r invariant torus 

T$, u := {(/(^.feftiJ^i^) : 0i,0 2 eR(mod27r)}, 

where p s (0i, 02; w ) is C r and 27r-periodic in 0i and 2 for (0i, 2 ) € R 2 . TJ w is 
stable and contained in the domain {(R,9) : \R — 8/3 1 < 6, 9 £ R 2 } for a certain 
5 > 0. 

Furthermore, for any (j3 ,w ) £ (f3~,/3+) x R with 1 < r < 7, let = (3 + e£i 
and w = ujq + e£ 2 for a sufficiently small e > such that 3 = [3 a + e£i € (/3~, /3+) 



for all |£i| < 1. Next, we append £ 1 = and £2 — to (4.1 1 to form an enlarged 
system with the additional components £1 and £2. Then by adapting our previous 
analysis for the enlarged system, reducing e further if necessary, we obtain that the 
enlarged system has C r invariant manifolds M u and M s which are the graphs of 
the C r functions, respectively, 

(0i, </>2, £1, £2) i-> P u ((f>i, 02; A) + e£i, ujq + e£ 2 ) and 
(0i, 02, £1, £2) !->■ /O s (0i, 02;/?o + e£i,^o + ££2) 

on the domain R(mod27r)xR(mod27r)x(— 1, l)x(— 1, 1). It follows that p M (0i, 025 (3, oS) 
and p s (0i, 02; (3, u>) are also C r in (3 and ui for (/3, to) £ (/3~,/3+) x R. Therefore, for 
each r = 1, ...,7, {T^ : (ftw) £ (/^,/9+) X R} and {T£ w : (/3,w) € X R} 

are C r families of C r invariant tori. 

Finally, we compare our estimates (i.e., (3~ and (3^ in Table [lj to some prelimi- 
nary numerical results: 



(1) By numerically integrating (4.1 1, we identify a region on the (/3, w)-planc 
bounded between the line (3 = and the curve Sq (see Figure [TJ such that 
for ( |4.1[ ) with any {[3, uj) in this region, solution trajectories that start on 
the plane {(R, 0i, 02) : R = 5} all reach the plane {(R, 0i, 02) : R = — 5}. 



Note that for (4.1 1 with (3 < fa, R < if R < -5 or R > 5. Thus, 



we conclude that no invariant torus exists for (4.1l with any (/?, u>) in this 
region. In addition, when we continue the tori and Tjf u along a path 
with constant u> starting at a (3 between and /3J and moving towards the 
curve So, we observe that u and TJ w continue to exist even for (3 < (3^ , 
but as (/?, w) gets close to So, both tori go through a series of bifurcations 
and then disappear. We have not yet studied these bifurcations in detail 
since it requires a much more delicate numerical analysis, which is out of 
the scope of this work. 
(2) By sweeping the region (3f < (3 < 9 and —2 < uj < 2, we find that for some 
(f3,u), the a-limit set of consists of a saddle-type periodic orbit Pi 
and a non-saddle-type unstable periodic orbit P%. In addition, the tangent 
bundle of R 3 restricted to P 2 has the splitting: TR 3 |p 2 = Ni ® N 2 8 TP 2 



such that both Ni and N 2 are invariant under the linearized flow of (4.1) 
along P 2 and Tp u is tangent to N 2 along P 2 . Since the linearized flow 
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along Pi expands both N\ and Ni, the ratio between the expansion rate in 
Ni and the expansion rate in N 2 determines the smoothness of To u . By 
continuing Tg w and Pi and monitoring the expansion rates in N\ and N2, 
we obtain the level curves Si , Sg (see Figure [2j, along which the ratio 
between the expansion rates in Ni and Ni are integers 2, 9, respectively. 
In addition, we find that for any (/3, ui) on the curve Si, the bundles Ni and 
N2 merge, and then for ((3, ui) on the right-hand side of Si, the two bundles 
emerge again, however, both rotating nir (n € Z\ {0}) for one period of 
Pi- Thus, Tp does not exist for any {(3,oj) on the right-hand side of Si, 
and Tg u is exactly C r (i.e., not C r+1 ) for any ((3,oS) in the region bounded 
between S r +i and S r (r = 1, ...,8). We remark that Tp u can be C r with 
r > 10 for some (j3, uS) on the left-hand side of Sg. 




Figure 1. j3~ and the curve on the (j3, ui) -plane. No invariant 
torus exists for (4.1 1 with any (j3, ui) in the region bounded between 
the line (3 = and the curve Sq. 



4.2. Invariant Torus in a System with Rapid Oscillations. In [5], Chicone 
and Liu studied the existence of an invariant torus in the following system: 

A(a)p + A(cr) + fiR(p, a, r/fi 2 , fi) , 



(4.10) 



P - 

& = p + fiS(p,a, r/p 2 ,^) 
t = 1. 



where ' = 4~ for a slow time s, p, > is a real parameter, p 6 R, and cr € [0, 27r] and 
t (E [0,27r/z 2 /o;] for a fixed ui > are angular variables with the corresponding end 
points identified. In addition, (4.101 is assumed to be class C°°. Note that pR and 



pS are fast oscillatory in r for p small. 
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Sg Sg S7 S(, S5 S4 S3 



S 2 Sl 




Figure 2. /?+ and the curves S, on the (/?, w)-plane. Tg w does not 
exist for any (/3, uj) on the right-hand side of Si, and Tg u is exactly 
C r (i.e., not C r+1 ) for any ((3,lj) in the region bounded between 
S r +i and 5 r (r = 1,...,8). Note that our theoretical estimates 
predict that TJ^ is (at least) C r for any (j3,w) £ (PriPr) x R 
with 1 < r < 7. 



After the truncation of the O(p) terms pR and fj,S, (4.101 becomes 

p= A(a)p + A(a), 
(4.11) (T = p, 

f = 1. 

It is assumed in [5] that A(<r) 7^ and A(er) < for all a £ [0,2tt). Then the p-a 
subsystem of (4.111 has an attracting limit cycle, whose existence can be proved 



by an easy application of the Poincare-Bendixson theorem, and the suspension of 
this limit cycle in (4.111 forms an invariant torus Mq. An immediate question is 



whether or not M.$ persists in the system (4.10 1 for /i > but small. Note that the 



attracting torus A^o is r-normally hyperbolic with respect to (4.11 ) for any integer 
r > 1 and its strength of normal hyperbolicity is independent of any parameter. 
However, the persistence theory of r-normally hyperbolic invariant manifolds by 
Fenichel [S] a nd Hi rsch, Pugh, and Shub [T4"| is not applicable in this case. The 



reason is that (4.10 1 may not be C 1 close to (4.11 ) even for small p since the partial 
derivatives of fiR and fiS with respect to r can be very large for small \x. On the 
other hand, by rescaling time to t := s/p? and taking 6 := r//i 2 , we transform 
into (1.131 with w = (/?, a) and e = /i 2 . Then, in the 0(e) truncation of 
(i.e., w — eFi(w), 9=1), the normal hyperbolicity of the corresponding 
unperturbed invariant manifold depends on the small parameter e, which raises the 
problem of weak hyperbolicity as discussed in Subsection |1.2| 



(4.10 



1.13 
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The main result of Chicone and Liu is that for any integer r > 2, (4-10) with 



p > but sufficiently small has an r-normally hyperbolic invariant torus C r dif- 
feomorphic to Mq. In addition, by time reversal, the same conclusion holds under 
the assumption that A(cr) ^ and A (a) > for all a £ [0,27r]. Chicone and Liu 
also remarked that this result is not valid if A is allowed to have zeros and the 
formulation of correct hypotheses needed to prove an analogous result in this case 
is "an interesting open problem" . One of the difficulties is that even the existence 
of a C r invariant torus for 



We now apply Theorem 



1.1 



11 1 is not readily available if A has zeros. 



and Theorem 1.3 to establish a C r (r > 1) invariant 
torus for (4.10) even if A has zeros. In preparation for our analysis, we lift a and 
t to M and then rescale them to 6\ :— k~ 1 a and 62 '■= rj p? with the scaling 
factor k > to be determined later. In addition, we introduce an auxiliary variable 



6 3 £ (—2,2) to (4.101 to form an enlarged system, which is written in the form of 



( 1.3 1 as follows: 



(4.12) 



P = f(p,8) 
o = g(p,o) 



A(k6 1 )p + A(fc0i) + 3 pR(p, k9 1 ,0 2 ,p) 



\e 3 pS{p,ke 1 ,e 2 ,pY 







where 6 :— (61,62,03), A and A are 27r/fc-periodic in 9%, and R and S are 2it/k- 
periodic in 6\ and 27r/w-periodic in 62- Note that we have treated p and 6 as "a" 
and "z" of (1.3 1, respectively. 



Assume A(cr) > for all a £ [0, 2ir}. Define constants E\, E2, and E as follows: 



Ei := 



mm 

cre[0,2rr] 



(4.13) 



Ei 



E 



max 

<tS[0,2it] 



{\Ei 



A(tr) 

A(a) 
\Ei\} 



We shall consider (4.12) on the domain 

U s := (Ei - 5, E 2 + S) x R 2 x (-2, 2) , 

where 8 £ (0, 1] is another fixed constant to be determined. Obviously, Us as defined 
above satisfies Hypothesis [l] Now, we need to establish the existence of a positively 
invariant set L that is contained in Us and satisfies 



(4.14) 



T1 ± (T) = IL ± (U S ) = R 2 x (-2,2). 



where H ± is the projection onto the 0-coordinate. In the same way as we have done 
for the example in Subsection |4.1| we define L C Us to be the set of points that 



stay in Us forever along solution trajectories of (4.121 in forward time so that L is 
the largest positively invariant subset of Us by definition. Then we show that T 



satisfies (4.141, again, using the Wazewski theorem. 



By the definitions of Ei and Eq, and the assumption that A (a) > for all 
a £ [0, 27r], it is straightforward to verify that for M := mm ae [ a 2TT] A(cr) > 0, 

p > MS - 2/i||i?|| for any (p, 6) with p > E 2 + 5, 

p< -M5+ 2p\\R\\ Q for any (p, 6) with p<E 1 -6, 
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where ||i?||o is the uniform norm of R{p, k9i, 8 2 , p) on the domain (E\ — 1, E 2 + 1) X 
R 2 x (0, 1]. Then for any <5,/i6 (0, 1] satisfying 



(4.15) 

p > for all (p, 1 
follows that {-Ei 

[Ei — S,E 2 + 5] x R 2 x (—2,2) immediately along solution trajectories of (|4.12| in 



M5-2p\\R\\ > 0, 

1 with p > E 2 + S, and p < for all (p, 8) with p < E x — 5. It 
5, E 2 + 5} x R 2 x (—2, 2) is the set of points which leave the set 



forward time. Then, the latter is a Wazewski set, and by the same arguments as 



what we have used in Subsection |4.1| we can show that T does satisfy (4.141. 
Next, we verify Hypothesis [2] and Hypothesis [2^ for (4.121 on Us- Straightforward 



calculation shows that for any (p, 8) € Us and any (p',8') € 



(p',D p f(p,0) p') > (A(fc0i)- 2p\\D 1 R\\ )\p' 



(e>,D eg (p,6)9>)<^\\s\\l + M\d 2 s\\1 + ^iia^)' ||0'll 2 ; 

\\Dgf(p, 8)\\ < (k 2 (\\DA(kdi)\\(E + 6) + \\DA(kdx)\\ + 2^\\D 2 R\\ o y 



4p 2 \\D 3 R\\ 2 



i 2 \\R\\ 2 o 



D p g(p,e)\\ < i(l + 2 A1 ||D 1 5|| ) ) 



where DiF — ^F{xi,x 2l x 3 ,x^) for i = 1,2, 3, and F = R, or S, and || • |j denotes 
the uniform norm of functions of (xi, x 2 , X3, X4) on the domain (E\ — 1, E 2 + 1) x 
R 2 x (0, 1]. Thus, for any triple (p, k, S) € (0, 1] x (0, 00) x (0, 1] such that 



(4.16) 

(A(fefli) - - KMSfo + M\D 2 S\\ 



k 2 1 



- ^ 2 (||i?A(^ 1 )||(E + S) + H.DA^i)!! + 2p\\D 2 R\\ ) +Ap 2 \\D 3 R\\ 2 + p 2 \\R\ 
-i(l + 2/x||£> 1 5|| ) >0 



holds for all k8\ £ [0, 2tt), ( 1.6c[ ) (with a sufficiently small c x ) and hence Hypothesis 
[2] are satisfied on the domain Us- Therefore, by Theorem |1.1| ( |4. 15 1 and (4.16) 
together guarantee that T is a C 1 positively invariant manifold contained inside 
Us- Furthermore, if there also exists an integer r > 2 such that 



(4.17) 



(A(k8 1 )-2p\\D 1 R\\ )-rp(±\\S\\ 2 
-(r + lU(l + 2M|piS||o) >0 



M\d 2 s\\ 2 + Md 3 s\\ 



holds for all k8\ e [0,27r], then ( |1.6| 1) (with a sufficiently small c r ) and hence 
Hypothe sis [2^ are satisfied on the domain Us- Consequently, if the triple (p,k,S) 
satisfies (4.15)-(4.17) for some r > 2, then T is in fact a C r manifold by Theorem 
Ol 



Note that with (4.15 )— ( 4.17 1 , we can determine for each positive integer r a 



subset of (0,1] such that the system (4.121 with any p chosen from this subset 
(if nonempty) possesses a C r positively invariant manifold T, which is contained 
inside Us- In principle, these subsets can be identified in the same way as we 
obtain Table [l] in Subsection |4.1| However, the analysis would be difficult without 
explicit expressions of A, A, R, and S. On the other hand, if our only concern is 
what happens given that p is sufficiently small, we can derive a relatively simple 
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condition on A and A to guarantee the existence of the C r (r > 1) positively 
invariant manifold T for (4.12). 

First, we make some important observations: if for some k > 0, 

(4.18) A(o-) > k(\\DA(a)\\E + \\DA(cr)\\) + \ for all cr G [0,2tt], 

then we can always find an appropriate 5 G (0,1] and correspondingly a sufficiently 
small no > such that for any p e (0, po] the triple (/x, fc, 5) satisfies both (4.15) 
and (4.161; and if in addition to (4.181 there is an integer r > 2 such that 

A(cr) >{r+l)l for all cr G [0,2tt], 

then we can further reduce po if necessary so that for any /x G (0,/xo] the triple 
(/x, k,S) satisfies all ( 4.15| )-( |4.17 ). Next, we notice the following facts: 

& { ™? , {fc(|pA( < 7)||£+ ||£>A(<t)||) + i}} = 27Z, 
^ {^]^ ll ^ AWI|B + l|DAWI| ) + ^ (r + 1) s>} = ^^' 

where L := maXo.gfo.27r] {\\DA(a)\\E + ||DA(er)||}. It follows that if 



(4.19) 



r+l 



L for all cr e [0,2tt], 



> ^ 

then there always exist a fc > 0, an appropriate 6 G (0, 1], and correspondingly a 
sufficiently small /xo > such that for any p G (0, po] the triple (/x, fc, <5) satisfies 
both ( 4.151 an d ( 4.16 1 when r = 1 i n ( |4.19[ ) and satisfies all ( |4.15[ )-( |417| when 
r > 2 in (4.19). Consequently, (4.121 with the corresponding /x and fc possesses a 
C r positively invariant manifold 

r = {(h(9 1 ,e 2 ,9 3 ;^k),0 u 9 2 ,e 3 ) : (0i,9 2 ,9 3 ) G M 2 x (-2,2)} , 

which is contained in [/^ with the corresponding <5. The function h(-, •, •; /x, fc) : 
M 2 x (-2, 2) -> (£1 - «J, S 2 + S) is C r . 

Although r depends on the choice of (/x, fc, 6) for (4.121 and Us, we can show 



by the same arguments as given in Subsection |4.1| that, up to a rescaling in 6*i, T 
coincides with any T' that is associated with any other admissible (/x, fc', S') as long 
as fi remains the same. In particular, similar to (4.8 1, we have that 



h{%,6 2 ,9 3 ;n,k) = h{§,9 2 ,9 3 ;fi,k') for all (cr,r) G R 2 . 

Furthermore, by the periodicity of ( |4.12 1 with respect to 9\ and 9 2 , we have that, 
similar to (4.9 1, h{9\, 9 2 , 9 3 ; /x, fc) is ^-periodic in 9\ and ^-periodic in 9 2 - Then, 
for any (3 G [0,1], the C r submanifold T\g 3= (i.e., the section of T at 9 3 — (3) 
corresponds to a C r torus 

Tpfl := {(p(a, r; /3, /x), cr, r) : cr G E(mod27r), r G M(mod ^)} , 

where p(cr, r; /?, /x) := /x(f, ^2, /3; /x, fc). Recall that p > for all (p, 9) with p > 
i?2 + <5, p < for all (p, (9) with p < E\ — 8, and T is the largest positively invariant 
subset of Us- Thus, T^p is the unique invariant torus for the following system with 
the corresponding p and (3: 

p = A(a)p + A(cr) + (3pR(p, cr, r/p 2 , p) , 
a = p + (3pS(p, cr, r/p 2 , p) , 
f = 1 . 
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Finally, since h is C r with respect to #3, we have that for every fixed fi £ (0,/Zo], 
{Tfj.,0 ■ (3 £ [0,1]} forms a C r family of tori. Thus we have established simul- 
taneously the existence of the invariant torus T^i for (4.10), the existence of the 
invariant torus A4q := T^.o for (4.111, and the fact that is C r diffeomorphic 
to jV(o- Notice that the existence of Ado f° r (4.11) is not among our assumptions. 
We summarize these results in the following proposition as an answer to the open 
question posed by Chicone and Liu in [5]. 

Proposition 4.1. Suppos e (4-10) is class C°° and A (a) > for all a £ [0, 27r]. 
Let E be defined as (4-13), and define L :— max^gro 27r] {ll^^( <T )ll^' + ll-D^( cr )ll}- 
If there is an integer r > 1 such that A(er) > for all a £ [0, 2-k], then 

(1) (4-lD has a unique C r invariant torus Aio; and 

(2) there exists a sufficiently small [j,q > such that for any fi £ (0,/io], (4-10) 
has a unique C r invariant torus T^ i, which is C r diffeomorphic to M . 

4.3. Persistence of a Weakly Normally Hyperbolic Invariant Torus. In this 
subsection, we consider the persistence of a weakly normally hyperbolic invariant 
torus in the following system: 

w = eF^w) + e 1+f *F 2 (w, 0, e) , 
6 = 6 + e v G x {w, e) + e 1+ ^G 2 (w, 9, e) , 
9 £ T m , 0<e<Cl, and the power indices fi, v, and 7 satisfy 
H > 0, 
7>0, 
1 > v > 0, 
fj, + v > 1 . 



(4.20) 
where w £ 

(4.21) 



Assumption 4.2. F% is C r+1 (r > 1). F2, G\, and G 2 are C r with respect to 
(w, 9) and continuous with respect to e for e £ [0, eo]. 

Suppose the averaged equation w — eFi(w) has a periodic orbit S. Note that 
the existence and the geometry of this periodic orbit is completely determined by 
the vector field F 1 (w) and independent of e. Furthermore, the C r+1 smoothness of 
Fx implies that S is C r+2 . Thus T := S x T m is a C r+2 invariant (m + l)-torus 
for the following truncated system with any e > 0: 

w = eFi(w) , 

(4.22) 

9=e + e v G l {w,e), 

where e 1+fl F2(w, 9, e) and e 1+1 G2(w, 9, e), the terms that are higher order in e, are 
excluded. We assume that To is normally hyperbolic with respect to the flow of 
(4.221 for any e > 0. This is true if and only if the periodic orbit S is hyperbolic 
with respect to the flow of the averaged equation w = eFi(w) for any e > 0. Thus 
we formulate the hyperbolicity assumption as follows: 

Assumption 4.3. Let x(£) with x(0) £ S be a periodic solution of ^ = Fi(w), 

and let £0 be the period of x(C)- The linear variational equation ^ = DFi(x(()) w 
has n linearly independent solutions whose Lyapunov exponents n,...,r n satisfy 

a u := min {n : I < i < n u } > , 

— <r s := max : n u + 1 < i < n u + n s } < , 



and 



0, 
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where the integers n u and n s satisfy n u > 1, n s > 1, anrf n„ + n s + 1 = n. 

We will prove the following theorem about the persistence of Tq in the full system 



(4.201 for small e. 



Theorem 4.4. Consider \4-20 ) with /i, v, and 7 satisfying (4-21). Suppose As- 
sumption 4.2 and Assumption 4-3 hold. Then there exists an e* G (0,eg] such that 



for ( 4-2Cty with any e G (0, e*], there is a unique invariant torus T e inside an 0(1)- 
neighborhood (i.e., independent of e) of Tq. In addition, T e is C r diffeomorphic 
and O(e ll )-close to Tq. In particular, T e has the parameterization 

(4.23) T £ = {(w, 6) : w = X (0 + HO Q(C, K(modCo), 9eT m }, 

where g(-,-,e) : M(modCo) x T m -> R"" 1 is an O(e^), C r function and h : 
M(modCo) - * M nx (™ -1 ) is a C r+1 matrix function such that for each ( G R(mod£o) 
the columns of h(() form a basis of the normal space of the periodic orbit S in R™ 
at X (0- 

Let r\ : R — » R TIX ("~ 1 ) be a C r+1 , bounded matrix function such that the n x n 
matrix (77(C) J=x(C)) i s nonsingular and its inverse is bounded for all Q G M. 
For a sufficiently small A > 0, we make a C r+1 change of variables in a small 
neighborhood of the periodic orbit S as follows: 



(4.24) 

where ( g R, a e 



ith ||a|| < A, and b G R" 



with < A. By Floquet's 



theorem, Assumption 4.3 implies that we can choose a 2£o-periodic 77(C) such that 
in the a-6-C coordinates, the averaged equation w — eF\{w) is transformed into the 
following normal form: 

a = e(A a + Ai(a, b, ()) , 

(4.25) b=e(B b+B 1 {a,b,0), 

C = e(l + 7i(a,6,C)), 

where both the n M x n u constant matrix Aq and the n s x rt s constant matrix Bq are 
in real Jordan form, and the functions A\{a, b, C), B\(a, b, C), and V\(a, b, C) are all 
C(||a|| 2 + ||&|| 2 ) and 2Co-periodic in C- Furthermore, the real parts of the eigenvalues 
of Aq coincide with the Lyapunov exponents r l5 ...,r„ u , and the real parts of the 
eigenvalues of Bq coincide with the Lyapunov exponents r n „+l; — j r n u +n s - 

We will make a further change of coordinates by rescaling individual components 
of a and b so that we can verify (1.6a I for the transformed system. Since Aq and 



Bq are in real Jordan form, it suffices to illustrate how to rescale the components 
of a that are associated with the same Jordan block Aqj of Aq. Suppose we have 



.4, 



/ 




£„ 


1 








°\ 






r K 





1 
















r K 


6. 


1 















»•« 





1 
















r K 




V 














-L 


rj 



0,3 



where r K is one of the positive Lyapunov exponents specified in Assumption |4.3 



and r K ± Ck * are the pair of complex eigenvalues of Aq j . Let a 



be the 
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corresponding components of a that are associated with Aqj. Define 

/l 

We, 



a.7,i 



A, 



where A„- 



(I 














\ 





1 




















hi 




















A.7,1 
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Aj,2 





v° 














A„ 2 y 



It follows that 



P 



0,3 



/ 




6. 


Aj,i 
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r K 





Aj,l 
















r K 


6. 
















-£« 


r K 






















V 



















Notice that for any c > 0, there exist Aj.i, A 3! 2 > such that 
(v, Pa,j V) > {r K - c)\\y\\ 2 for any y e R 6 . 

For each Jordan block of A and B 0l we apply similar rescaling if necessary to 
the corresponding components of a and b so that under the change of coordinates 
(a, b) i ► (p, g), (4.251 becomes 

p = e(P p + Pi 0,5,0), 

<? = ({Qvq + Qi{p,q,Q) , 

C = c(l + ^i(p,9,0). 
with Po and Qo now satisfying 

(4.26a) (p, P p) > cr||p|| 2 for any p E M n " , 

(4.26b) (q,Qoq) < - v\\q\\ 2 for any q e R n ", 

where er is a positive constant satisfying < a < min { a s , <j u } . We denote this 
change of coordinates by (a, 6) = q). 

We now obtain a normal form of the full system ( 4.20| near the torus Tq in terms 
of (p, q, (, 8) as follows: 

p = e(P oP + P x (p, q, 0) + e 1+ ^P 2 (p, 9, C, 0, <0 , 



(4.27) 



q = e{Q Q q + Qi{p, q, Q) + e 1+ »Q 2 (p, q, (, 9, e) . 
C = e(l + Zrip, q, £)) + e 1+ »Z 2 (p, q, £ 0, e) , 
9 = 6 + e"e x (p, g, C, e) + e 1+ ^e 2 (p, q, (, 9, e) 



where ||p|| < So and \\q\\ < So for a certain So > such that v(p,q) £ {{a,b) : 
\\a\\ < A, < A}. In addition to taking ( € R, we lift 9 to R m in the subsequent 
analysis. Based on Assumptions 4.2 and 4.3 and the preceding changes of variables, 
we can easily verify a set of properties regarding the smoothness, boundedness, 
and periodicity of the functions on the right-hand side of (4.27). We state these 
properties in the following lemma while omitting their straightforward verifications. 

Lemma 4.5. Let D := {(p,q) : ||p|| < S , \\q\\ < S }. 
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(1) The constant matrices P$ and Qo satisfy ( 4-26\ ). 

(2) The functions Pi, Q\, and Zi are C r on D x K. 

(3) The function @i is C r with respect to (p,q,Q and continuous with respect 
to e on D x E x [0, eo]. 

(4) The functions P2, Q2, Z2, and 2 are C r with respect to (p,q,C->9) an d 
continuous with respect to e on Do x M x R m x [Q, eo]. 

(5) There exist positive constants C\ and C 2 such that for any S G [0, 6q] and 
any \\p\\ < S, \\q\\ < 5, and Q G R, 

HA||<c 1( 5 2 , hqi||<^ 2 , i^iii <c^ 2 , 

\\D c Pi\\ <C\S 2 , \\D c Qi\\ <d6 2 , \\D c Zi\\ <dS 2 , 

WD^W < C 2 S , WD&W <C 2 S, WD&W <C 2 S, 

where t; = p or q in the last three inequalities. 

(6) There exist positive constants C3 and C4 such that for any (p, q) G Do, 
CelJe W n , and e G [0,e ], 

\\P2\\<C 3 , ||Qa||<C?3, \\Z 2 \\<C 3 , 

IIQill < c 3 , l|e 2 ||<c 3 , 

||^P 2 ||<C4, ||D € Q a || <C 4) \\D C Z 2 \\<C 4 , 

Pf©i|| <C 4 , |p £ e 2 || <C 4 , 

where £, — p, q, C> or 

(7) The second to r-th derivatives of Pi, Pi, Q\, Q2, Z\, Z 2 , ©i, and 2 
with respect to (p,q,() or (p,q,C>9) are all bounded on the corresponding 
domains specified in (2), (3), and (4)- 

(8) The functions Pi, P2, Qi, Q2, Zi, Z 2 , ©i, and ©2 are 2( > o-periodic in 
£ and 2ir -periodic in each component of 9 on the corresponding domains 
specified in (2), (3), and (4). 



We now show that for every fixed, sufficiently small e > 0, (4.271 has a C r 
positively invariant manifold. We introduce another two rescaled variables: q := q/2 
and 9 := k~ l 9 with the scaling factor k > to be determined later. By taking 
z = (q, £, 9) and treating p as "a" , we organize the rescaled system into the form of 
( 1.3 1 as follows: 

p = f(p, z) := e(P aP + Pi(p, 2q, C)) + e 1+ ^P 2 (p, 2q, C, k§, e) , 

(4 28) / <Qoq+ \Qi{P,n,Q) + |e 1+ "Q 2 (p,2g,C,^,e) 

z = g(p,z):=\ e(l + Z 1 (p,2qX)) + e 1 +»Z2(p,2qX,k6,e) 

\i0o + (p, 2g, C, c) + ^ 1+7 © 2 (P, 25, C, fcfl, e), 

We shall restrict (p, z) — (p, q, £, 9) to the domain 

U 5 := {IHI <*} x {||q|| < §} xlxl" 1 , 

where (5 G (0, <5o] is to be determined. Obviously, Us satisfies Hypothesis [T] As we 
have done for the previous two examples, we define T e ^^ C Us to be the set of 
points that stay in Us forever in forward time along solution trajectories of ( |4.28 1, 
that is, 

(4.29) I\ M := {(p,z) : * e , k (t,(p,z)) G U s for all t > 0} , 
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where $ e ,fe(i) (p> %)) is the flow of (4.281. By this definition, T e ,k,s is the largest 
positively invariant subset of Us under the flow $ e ,k- Then we need to prove that 
r e k 6 satisfies 



(4.30) 



n±(T e , k , s ) = n x (u s ) = {\\q\\ < §} 



where II x is the projection onto the z-coordinate. Again, we will achieve this using 
the Wazewski theorem. However, since p sits in R n ™, some arguments arc slightly 
different. 

Lemma 4.6. There exist t\ £ (Q, eo] and Si S (0,<5o] satisfying 2^-e^ < 5i such 
that for (J^.28) with any e S (0,ei] and Us with any 5 £ [2— ^e'*, <5i], the positively 
invariant set V e ,k,8 C Us satisfies (4-3Cty . 

Proof. We partition the boundary of Us into two subsets Si and S*2 as follows: 

51 ■= {\\p\\ = S} x {||g|| < §} xlxl™, 

5 2 := {W <6} x {Hffll = §} xlxl™. 



Using (4.26a I and the estimates in part (5) and part (6) of Lemma 4.5 we obtain 
that for any point in Si, 

(p,p) = (p,e(P Q p + Pi(p,2q,Q)) + (p,e 1+ »P 2 (p,2qX,W,e)} 

>e(p,P a p)-eCi6 2 \\p\\-e 1+ »C 3 \\p\\ 

>eo-\\pf-eCi6 2 \\p\\-e 1+ »C 3 \\p\\ 

= eS(cr6 - C\S 2 - e^d) . 

Similarly, for points in S2, we have 



l(p,2«,C))) 



(q, 



h(p,2q,C,ke,e)) 



<e{q, Q q) + hCi5 2 \\q\\ + U 1+t *C: 



3 I Kill 



< -ea\\q\\ 2 + ^edS 2 \\q\\ + ^d 3 \\q\\ 
= - e\{a5 - dS 2 - e»C 3 ) . 

Since for fi > 0, e M — > as e — > + , we can take ei £ (0, eo] and 5i € (0, #o] such 
that 2^6^ < (5i < ^gr;. Then for any e G (0, e x ] and any <5 € [2^-e' 1 , 

08 - dS 2 - e"C 3 > cr(2^e") ~ Ci(2^) 2 - e"C 3 

= C 3 e» -AdCl^e^ >0, 

where the last inequality can be guaranteed by choosing t\ sufficiently small. It 
follows that Jj|H| 2 > for any point in Si and g^||<z|| 2 < for any point in 5 2 - 
Then solution trajectories of (4.281 leave and enter cl(Ug) through points in Si and 
52, respectively. In particular, Si is the set of points through which trajectories 
leave cl(Us) immediately in forward time. Then it can be easily verified that cl(Ug) 
is a Wazewski set. Let Ug C cl(Ug) be the set of points that do not stay in 
cl(Us) forever in forward time. By the Wazewski theorem, there exists a continuous 
function TZ : Ug X [0, 1] — * Ug such that TZ is a strong deformation retraction of Ug 
onto Si- 

Suppose that for a certain z* = (q* , (* , 6*) £ {\\q\\ < f } xlxl, 



(4.31) 



r eiM n{(p>0 : \\p\\ < 5 } = 
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where the second set on the left is just the section of Us at z* . Since {(p, z*) : 
\\p\\ = S} C Si C U ( J, (4.311 implies that the set {(p,z*) : \\p\\ < 5} is contained 
inside the domain Ug of the continuous function 1Z( ■ , 1) : U® —> Si. This allows us 
to construct a continuous function that maps the closed n u -ball {||p|| < (5} to its 
boundary {||p|| = S\: 

P^no%,4i), 

where II is the projection onto the p-coordinate. Since 1Z is a strong deformation 
retraction of Ug onto Si, TZ({p,z*),l) = (p,z*) for any (p,z*) g Si. Thus, the 
above continuous function has the property that for any p with ||p| = 8, 

IloK((p,z*),l) = Il(p,z*) = p. 

The existence of such a continuous function contradicts the fact that there is no 
retraction that maps a closed n-ball onto its boundary (i.e., an (n — l)-sphere). 
Thus, IY fe ^ P| {(p, z) : ||p|| < <5} ^ for any z g {||q|| < |} x K x M"\ This proves 



Next, using (1), (5), and (6) of Lemma [4.5| we obtain the following estimates 
regarding D p f(p,z), D z g(p,z), D z f(p,z), and D p g(p, z) for any (p, z) g U s . 

(1) For any p' g R n «, 

(p',D p fp') = (p\ (eP Q + eD p Pi + e l+ »D p P 2 )p') 
> ea\\p'\\ 2 ~ eC 2 S\\p'\\ 2 ~ e 1+ ^C A \\p'f 

= a u \\p'\\ 2 , 

where 

a u := e(c7 - C 2 <J) - e 1+ "C 4 . 

(2) For any z' = (q', $') G K n - x R x M m , 

(z', D z g z') = (g', (eQ + eD,Qi + e 1+ ^ 9 Q 2 ) q') + (q\ \kt 1+ ^D e Q 2 B') 

+ {q'i(\tD Q Qi + \e 1+ »D c Q 2 )0 
+ (C, (2eD q Zi + 2e 1+ »D q Z 2 ) <f) + ((', ke 1+ ^D e Z 2 9') 

+ (C. / (eD c Zi+e 1 +»D c Z 2 )C) 
+ {&, (2^D q ei + 2± e 1+ ^9 2 ) q') + (9', e 1+ ''Dee 2 9') 

+ (0',(ie^ c e 1 + i e 1+ ^ c e 2 )c') 

< - ea\\q'\\ 2 + (eC 2 8 + e^C^f + §*e 1+ "a t ||3'||||0'|| 

+ C^eCiS 2 + ^C^Wq'lWCl 
+ (2eC 2 S + 2e 1+ ^C 4 )\C\\\q'\\+ke 1+ ^C 4 \C\\\9'\\ 

+ {eCi5 2 + e 1+ »C i )\C'\ 2 
+ (2±e"C 4 + 2±e 1+ ~'C 4 )\\9 , \\\\q / \\ + e 1+ TC 4 ||0'|| 2 

+ (K C 4+ie 1+7 C 4 )||0'|!|C'| 

<£u\\z'\\ 2 , 



where 



l u := e{3C 2 S + fC^ 2 ) + e 1+ ^|C 4 + e 1+7 C 4 
+ fce 1+ ^|C 4 + £(e"3<7 4 + e 1+7 3C 4 ) . 
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(3) 



To obtain the last inequality, we have discarded the negative term — ecr||g'|| 2 
and then used ||q'|| < ||z'||, |C'| < \\z'\\, and ||0'|| < ||z'||. 

\\DJ\\ < (||2eD ffJ Pi|| + \\2e 1+ »D q P 2 \\) + (WeD^W + \\e 1+ »D ( P 2 \\) 
+ j|fce 1+ ^D e P 2 || 
< (2eC 2 5 + 2e 1+t *C 4 ) + {eC x 8 2 + e 1+t *C 4 ) + ke 1+ "C 4 
= L f,z , 

where 

L ftZ := e(2C 2 5 + d5 2 ) + e 1+t *3C 4 + ke 1+t *C 4 ■ 



(4) 



\\D p g\\ < (HleDpQill + || \e 1+ »D p Q 2 \\) + (||e£> p Zi|| + \\e 1+ »D p Z 2 \\) 
+ (||ie"£> p e 1 || + ||4e 1+ ^ p 6 2 ||) 
< (\eC 2 5 + \e 1+ ^C 4 ) + (eC 2 5 + e 1+ »C 4 ) + (\< V C 4 + 4e 1+7 C 4 ) 

where 

Lg, p ~ 4C 2 5 + e 1+ ^C 4 + \{e v C 4 + ( 1+ ^C 4 ) . 

In order to verify Hypothesis [2] and Hypothesis^ for (4.281 on Us, we define an 
auxiliary function JC : (0, eg] x (0, oo) x (0, Sq] — > M. as follows: 

JC(e, k, 5) := a u - (ri u + (r + l)L 9tP + L ftZ ) 

= ea- e{K x 5 + K 2 S 2 + e"K 3 + e~<K 4 + k^K b + %(f?- l K 6 + e 1 K 7 )) , 

where r is the degree of smoothness referred to in (2) and (3) of Lemma |4.5| and 
the constants are defined as follows: 





= f(r- 


1- 1)C 2 , 


K 2 


= (§r- 


\- , 


K 3 


= (6r4 


- y)C 4 


K 4 


= rC 4 , 




K 5 


= (§r- 


\- i)c 4 , 


K 6 


= (4r4 


- i)c 4 , 


K 7 


= (4r 4 


- 1)C 4 . 



Lemma 4.7. There exist t 2 G (Q, £o] an d S 2 S (0,<5o] satisfying 2^-e 2 < 8 2 such 
that K(e,k e ,S) > for any e 6 (0,62], any S 6 [2^-e^, 5 2 ], and an appropriately 
chosen k e that depends on e. 

Proof. Note that for any e > 0, 

inf {ke?K 6 + \{e"- l K Q + e~<K 7 )} = (e^^K^e + e^K 5 K 7 ) * . 

fcg(0,oo) 

In particular, for every e > 0, there exists a k e > such that 

(4.32) k e e»K 5 + ^(e^Ke + ?K 7 ) < (e! i+v - 1 K B K e + e^K*,K 7 )* + \a . 
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By (4.211, we have 



0, e 7 



0, e^+'< -> 0, and e^" 1 



for 



Thus, there exist e 2 G (0,eo] an d ^2 € (0,#o] satisfying 2^e 2 < ^2 such that for 
any e G (0, e 2 ] and any <5 € [2^M', <5 2 ], 



\a > KtS + K 2 S 2 + e»K 3 + e^K 4 



(e» +v - l K,K« + e^K,K 7 



> KxS + K 2 5 2 + e»K 3 + e'K^ + k e e»K 5 + i(e* 
It follows that /C(e, k e , S) > lea > 0. 



e>K 7 ) . 



□ 



Lemma 4.7 guarantees that both (1.6c I and (1.61) hold for (4.281 on U$. Thus, 
by combining Lemma |4.6| and Lemma 4.7 we establish the existence and the C r 



smoothness of a positively invariant manifold for (4.281 as stated in the following 
lemma. 

Lemma 4.8. Ther e exist e* G (0,e ] and 5* G (0, S ] satisfying 2 ^e* M < S* 
such that for with any e G (0,e*] and any k = k t that satisfies (4-32), the 

positively invariant set T €j k e ,5* C Us* is the graph of a C r function h(-, •, -;e, k e ) : 
Hj_(Us») — > {||p|| < <5*} that satisfies 

(4.33) \\h(q 2 , ( 2 ,9 2 ; e, k e ) - %i,GA; e, k e )\\ < \\q 2 - qi\\ + |Ca - Ci| + P2 - 0i|| 

for any (q~i,(i,9i) and (q~2,C2,8 2 ) £ll ± (Us*). Furthermore, for each 6 £ [2^-6^,(5*]. 
the positively invariant set T Ct k CJ s = ^e,k r _,s* f] U$. 

Pro of. Ta ke e* = min{ei,e 2 } and 5* = min { St , S 2 } . Clearl y, 2^ e*^ < 5*. Thus, 
for (4.281 with any e G (0, e*j and any k — k t that satisfies ( |4.32[ ), Lemma 4.6 and 
Lemma 4.7 guarantee that both Theorem |1.1| and Theorem |1.3| are applicable on 
the domain Us = {\\p\\ < S} x {\\q\\ <^}xRxM ra with any S G [2^-6^,5*]. In 
particular, for 5 = S*, the positively invariant set T e ^ et s* C Us* is the graph of a 
C r function 

/ 1 (-,-,-;e ) fc e ):n i ([/ 5 ,) = {ll9ll < x M x R m — > {||p|| <«$*} 
that satisfies (4.331 according to Theorem |1.1| or Theorem |1.3[ Furthermore, 
for each S G [2^f e^,S*], n ± (T e ,k , s) = R±(Us) by Lemma ]4j] and T^ k ^ s C 
Te,k e ,8* ^5 by the definition Thus T c . krt5 = r e>fcei5 . f) □ 

We also have the following facts regarding the function h. 



(1) For any e G (0,e*] and any k e and k' e that both satisfy (4.321, 
(4.34) h(q,C,lje,k e ) = h(q,C,^;e,k' £ ) 

for all (q,C,9) G {||g|| < 4f} x E x M m . 



(2) For any e G (0,e*] and any fc e that satisfies (4.32), £, 0; e, fc e ) is 2£ - 
periodic in £ and ^-periodic in each component of 0. 



.321, 



(3) For any e G (0, e*] and any k e that satisfies 

\\h(q,t,8;e,k e )\\ < 2^e" 

for all (g,C,0) G {||<z|| < x R x M m . 

The first two properties should be familiar by now, and they follow from the 



definition (4.291 and the same arguments as given in Subsections 4.1 and 4.2 for 



the first two examples. The third property is a simple consequence of the fact that 

r £ , fce , s = r £ifce , 5 , n U S for 6 = 2^^. 
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By (4.341, we can define a C r function V(-,-,-;e) : {||q|| < <5*} 
{||p|| < 5*| for each e G (0,e*] as follows: 

V(q,t,0;e) :=h(l(,l;e,k e ), 



where k e can be taken to be any value that satisfies (4.321. Then it follows imme- 
diately from (4.33) that 

(4.35) \\V(q2,C2,e 2 ;e)-V(q 1 ,Ci,0 1 ;e)\\ < §||g 2 - qi \\ + \( 2 - Ci I + £||0 2 - 0i|| 

for any (gi,£i,#i) and ((72,(2,6*2) € {\\q\\ < 5*} x R x R m . In addition, by the 
properties (2) and (3) above, V(q, C, 0; e) is 2£ -periodic in ( and 27r-periodic in 
each component of 8, and 



(4.36) 



\P(q,(,8;e)\\<2^ 



for all (q,(,0) G {\\q\\ < 2^M} xlxl™ 

We now return to the normal form (4.271. The results stated in the next lemma 
are now obvious. 



Lemma 4.9. For any e G (0,e*]> (4-27) has a C r positively invariant manifold 
W+, which is the graph of the C r function V(-,-,-;e) : {\\q\\ < 8*} xRx R m — > 
{||p|| < <5*}. In addition, is the largest positively invariant subset of {\\p\\ < 
5*} x {\\q\\ < 6*} x K x R m . 



Notice that all the analysis starting from the formulation of (4.28) up to Lemma 
4.9 can be adapted (with only minor modifications) for the time reversal of ( |4.27 1. 
In particular, we let p :— p/2 while keeping 9 = k~ 1 6, and then form a system in 
the spirit of (4.28 1 but using the time reversal of ( |4.27 1 and treating q and (p, £, 0) 

previous steps, we 
{Ikll < <5*} whose 



as "a" and "z" of (j 1 . 3[) , respectively. Then, by following all the previous steps, we 

•;e) : {\\p\\ <6*}xRx 

; e), i.e. 



construct a C r function Q( 

properties are completely analogous to those of the function V{ 



(4.37) ||Q(p 2 ,C2,e 2 ; e) - Q(pi,CiA;e)|| < 5IIP2 - Pi\\ + IC2 - Cil + £||0 2 - M 

forany( Pl ,Ci,ei)and(p 2 ,C2^2) G {||p|| < 6*} xRxR m ; Q{p,(,9;e) is 2Co-periodic 
in £ and 27r-pcriodic in each component of 6; and 



(4.38) 



|Q(p,C,MII <2^e^ 



for all (p,£0) G {|b|| <2^e"} 



x R m . Then we establish the existence and the 
C r smoothness of a negatively invariant manifold for (4.271 as stated in the next 
lemma. 



Lemma 4.10. For any e G (0, e*], (4--21) has a C r negatively invariant manifold 
W~ , which is the graph of the C r function Q(-,-,-; e ) : {INI < $*} x M x R m — > 
{Hsll < <5*}- In addition, W~ is the largest negatively invariant subset of {\\p\\ < 
6*} x {\\q\\ <j'}xlx R m . 

Define M e :— f] W~ for each e G (0, e*]. Clearly, M c is invariant (i.e., in both 
forward time and backward time) under the flow of (4.27) with the corresponding 
e. Below we show that M € is in fact the graph of a C r function that maps R x R rn 
into {||p|| < 2^} x {|| ? || < 2^e> i } and thus a C r manifold. 
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Lemma 4.11. For any e 6 (0,e*], (4.21) has a C r invariant manifold M e = 
W+f]W~, which is the graph of a C r function p(-,-,e) : R x R m -> {\\p\\ < 
2 lT eA1 } x {ll^ll — 2y£ M }. In addition, M e is the largest invariant subset of {\\p\\ < 
6*} x {||q|| <j'}xlx R m . 

Proof. We consider an arbitrary, fixed e € (0, e*] throughout this proof. Define the 
map : {||p|| < 6*} x {\\q\\ < 6*} x R x R™ -» {||p|| < <5*} x {||g|| < 5*} as 
follows: 

T t { P ,qX,o) := (%,C^;e),C(P.C,«;e)), 

where "P(-,-,-;e) and Q(-,-,-;e) are the continuous extensions of "P(-,-,-;e) and 
Q(-, ■, •; e) onto {|| 9 || < <5* } x R x M m and {||p|| < 6 *} X R x R m , re spectively. 

Consider the norm ||(p, <z)||i := ||p| + ||q||. By (4.351 and ( 4.37| , we have that 
for any (C, 6) eRx R m and any (p 1 ,q 1 ) and (p 2) g 2 )G{||p|| <F}x {||g|| < 5*}, 

\\Fe(P2, ?2, C, 0) - ^(Pl) 91, C) 0)111 

= ||P( ?2 , C, 0; e) - C, 0; e)|| + \\Q(P2, C, 0; e) - C(pi, C, 0; <0|| 
< Ilia- gill + 3IIP2 -Pill 
= |||(P2 -pi,g2 - gi)||i • 

Thus, for each ((,0) € KxR" 1 , .F e (-, •, (, 6) is a contraction on {||p|| < 5*} x {||g|| < 

<5* } under the norm 1 1 • 1 1 1 . Then we can define a function p(-, •; e) : Rxl m -t {||p|| < 

<5* } x { Ikll < <** } such that for cach (C, 0) eRxR m , (p, g) = p(C, 6>; e) is the unique 
solution to the equation 



(4.39) 



(p,q) = .F e (p,g,C, 



'■ } = W+ p| , which verifies 



Clearly, we have {(p(C, 0; e), 0) : (C, #) G R x 
that M e is the graph of the function p(-, •; e). 

Next, we consider the restriction of ^ on {||p| < 2^-e M } x < 2^ a e M } x 

R x M m . By ( |4.36[ ) and ( |4.38| , we have that 

(P(qX,0;e),Q(p,(,e;e)) € {||p|| < 2f x {|| g || < 2 <fe»} 

for all (p,q,(,9) G {Ibll < 2 ^ eAI } x {IMI < 2^6^} x R x M"\ Thus, for each 
(C,6>) <E RxR m , J r e (-,-,C,6») is also a contraction on {||p|| < x {||g|| < 2^e' 1 } 

under the norm || • ||i, and the unique solution (p,q) to ( 4.39[ ) is in fact contained 
in the set {||p|| < 2^6^} x {||g|| < 2^e^}. Therefore, p(-, •; e) maps R x R m into 
{IMI<2^}x{|fg||<2<^}. 

Finally, we show that p((,9;c) is C with respect to (C>#) on R x R m using 
the implicit function theorem. Define a C r function Q e : {\\p\\ < <5*} x |||g|| < 
j'jxlx R m -> M n " x R n ° as follows: 

Note that at any (j>(t,6;e),{,0) G {||p|| < 2^e"} x {||g|| < 2^e"} 

D(p,q)Ge 



-D P Q I, 



-D q V 
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is always invertible since \\D q V\\ < \ by ( |4.35| and ||D P Q|| < \ by ( |4.37[ ). Then, by 
the implicit function theorem, the function p[-, •; e), which satisfies Q e (p(Q, 9; e), £, 0) = 
for all (C, 9)eMx M m , is C r on R x R m . □ 



Finally we return to the original system (4.20 ). By the periodicity of V(q, C, 9; e) 
and Q(p, (, 9; e) with respect to C and 8, we have that p((, 9; e) is 2£o-periodic in ( 
and 27r-periodic in each component of 9. Recall the changes of variabl es (|4.24 1 and 



Then Lemma 4.11 implies that for any e £ (0,e*], (4.201 has an 



(a, b) = v(jp,q). 
invariant set 

T t := {(w,6) : w = X (C) + v(0 v(p((,0; e)),(€ M(mod2C ), 9 £T m } , 
which is contained in an C(e M )-ncighborhood of To since the function p(-,-;e) is 
©(e''). To show that T e can be parameterized by (4.23), which uses the Co-periodic 
basis n((), we take a section at an arbitrary d £ [0,£o) as follows: 

E(Ci) := {(w,9) ■■w = X ((i)+v((i)v(p,q), \\p\\ < 5*, \\q\\ < 6*} , 
Clearly we have 

i?(Ci) := {(w,9):w = X (Ci) + v(Ci)v(p(Cu9;e)),9£T m }£T e f]nCi)- 
Suppose there exist a C 2 € [0, 2£ ) different from d and a 2 € T m such that 
(i«2,fla) € T e ns(Ci) for w 2 = x (Ca) + »/(Ca) w(p(6, #2; e)). Since (w, 2 ,0 2 ) e E(Ci) 
and /?(•, •; e) is C(e M ), there exists (ft, q) with both ||p|| and being 0(e^) such that 
w 2 = x(Ci) + ^(Ci) v (Pi <?)• Furthermore, since (1V2, #2) £ T e and T e is contained in 
an C(e A ')-ncighborhood of To, the solution trajectory of (4.201 that passes through 
(u> 2 ,# 2 ) is contained inside an C(e A ')-neighborhood of T forever in both forward 



time and backward time due to the invariance of T t under the flow of (4.201. Then 



for the normal form (4.271, the solution trajectory that passes through (ft, q, Cij^2) 
stays inside {\\p\\ < 5* \ x {\\q\\ < <5*} x M. x W n forever in both forward time 
and backward time. Recall that M e is the largest invariant subset of {||p| < 
5*} x {||g|| < 5*} x K x W n . Thus (ft,q,(i,6 2 ) £ M e , which implies that (ft,q) = 
p(Ci,6» 2 ;e). It follows that (w 2 ,(9 2 ) £ R(d). Then we have R(Ci) = T e f|E(Ci). 
Note that T e f|E(d) is C r diffeomorphic to the intersection of T e and the section 
{(w,6) : w = x(0 + h(()£, £ € K n_1 , ||£|| < A } fo r a ce rtain A > and any 
C £ [0,Co)- Therefore, T e can be parameterized by (4.231, and it is the unique 
invariant torus for ( |4.20 1 inside an C(l)-neighborhood (i.e., independent of e) of 
To- 

Appendix A. The Wazewski Principle 
We follow the presentation of Conley [5]. Let X be a topological space and 



if : 



x X 



X be a flow. For a set VF C X, we define the following sets: 

W° := {x £ W : 3t > such that <p(t,x) £ W) , 

W _ := {x £ W : tp([Q,t),x) % W for all t > 0} , 

where W° is the set of points that do not stay in W forever under the flow ip in 
forward time, and W~ is the set of points that immediately leave W in forward 
time. Clearly, W~ C W° C W. 

Definition (Wazewski Set). The set W is called a Wazewski set if the following 
conditions are satisfied: 
(Wl) If x £ W and tp([0,t],x) C cl(W) then p([0,*],:c) C W. 
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(W2) W~ is closed relative to W°. 

Theorem (Wazewski). If W is a Wazewski set, then W~ is a strong deformation 
retract of W° and W° is open relative to W . 

The proof of the above theorem can be found in 8, 16 . Here we only recall that 
when W~ is a strong deformation retract of W , there exists a continuous function 
r:W°x [0, 1] -► W° such that: (1) for all x € W°, r(x, 0) = x and r(x, 1) € W~\ 
and (2) for all x <E W~ and all a E [0, 1], r(x,a) = x. The function r is called a 
strong deformation retraction. 
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